Observability & evals

Open-source platform for tracing, evaluating and improving AI agents

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Open-source observability for LLM applications, built on OpenTelemetry

AI gateway and LLM observability platform for logging, debugging and routing LLM requests

Open-source, MIT-licensed platform for observing production AI agents and turning failures into tracked signals

Observability platform for AI apps covering model calls, agent steps, API requests and database queries in one trace

Open-source observability platform for AI agents that detects failures and supports evals

Observability and dev-tool platform for building, evaluating and monitoring AI agents

Deployment-readiness platform for voice AI agents: simulate calls, evaluate production conversations and add human review

Platform for developers of AI chatbots and LLM apps, covering monitoring, prompts and analytics

Collaboration layer for AI engineering teams: prompt management, agent observability and evals

Simulation platform for building frontier AI agents, testing them on realistic scenarios with evals

Trust platform for voice and chat agents: pre-launch testing, red teaming and production monitoring

Open-source workspace where teams build AI agents by chatting and run them in Slack, WhatsApp or Telegram

Open-source Python library for evals, red teaming and test generation for agentic systems

Platform for agent observability and evals: trace agents, score outputs and find patterns in production