Observability & evals

Open-source platform for tracing, evaluating and improving AI agents

Open-source platform for tracing, evaluating and managing prompts for agents, LLMs and ML models

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source tool to trace, evaluate and improve AI agents, run locally or self-hosted

Open-source observability for LLM applications, built on OpenTelemetry

AI gateway and LLM observability platform for logging, debugging and routing LLM requests

Open-source, MIT-licensed platform for observing production AI agents and turning failures into tracked signals

Observability platform for AI apps covering model calls, agent steps, API requests and database queries in one trace

Continuous-improvement stack for agents: monitor behavior, detect failures and validate fixes

Open-source observability platform for AI agents that detects failures and supports evals

Open-source agent harness engineering platform with OpenTelemetry tracing, evals and guardrails

Toolkit for tracing and evaluating AI agents and LLM apps, built by Weights & Biases

Observability and dev-tool platform for building, evaluating and monitoring AI agents

Open-source observability for AI apps: traces LLM calls, prompts, retrieval and agent steps via OpenTelemetry

Platform for developers of AI chatbots and LLM apps, covering monitoring, prompts and analytics

Control plane for enterprise AI agents covering monitoring, evals, enforcement and governance

Monitoring platform for AI agents that discovers silent agent failures in production

AI engineering platform for observing, evaluating and improving AI agents

Agent observability platform for tracing, evaluating, monitoring and improving AI agents

Collaboration layer for AI engineering teams: prompt management, agent observability and evals

Connects prompts, model calls, tool use, cost and failures to help debug LLM apps and agents in production

AI observability with real-time evaluators, dashboards, session tracing and cost tracking for AI agents

Monitor the performance, usage, cost and guardrails of LLM and agentic AI apps in Elastic Observability

APM-based AI monitoring for end-to-end visibility into the performance, cost and quality of LLM apps