Observability & evals

Open-source CLI and library for evaluating and red-teaming LLM apps and agents

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

Test, monitor and self-improve voice agents with simulation, red teaming and production monitoring

AI governance platform to discover, test, monitor and govern AI systems and enforce controls

Simulation platform for building frontier AI agents, testing them on realistic scenarios with evals

Open-source workspace where teams build AI agents by chatting and run them in Slack, WhatsApp or Telegram

Enterprise agent security and governance platform covering agent discovery, guardrails, evals and traces

Open-source framework to evaluate, test and monitor ML and LLM systems

Open-source Python library for evals, red teaming and test generation for agentic systems

Platform for agent observability and evals: trace agents, score outputs and find patterns in production