Observability & evals

Open-source platform for tracing, evaluating and improving AI agents

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Observability platform for AI apps covering model calls, agent steps, API requests and database queries in one trace

Open-source observability platform for AI agents that detects failures and supports evals

Toolkit for tracing and evaluating AI agents and LLM apps, built by Weights & Biases

Observability and dev-tool platform for building, evaluating and monitoring AI agents

Test, monitor and self-improve voice agents with simulation, red teaming and production monitoring

Deployment-readiness platform for voice AI agents: simulate calls, evaluate production conversations and add human review

Collaboration layer for AI engineering teams: prompt management, agent observability and evals

Trust platform for voice and chat agents: pre-launch testing, red teaming and production monitoring

APM-based AI monitoring for end-to-end visibility into the performance, cost and quality of LLM apps

Enterprise agent security and governance platform covering agent discovery, guardrails, evals and traces

Open-source Python library for evals, red teaming and test generation for agentic systems

Platform for agent observability and evals: trace agents, score outputs and find patterns in production