Everything in the catalog

Open-source CLI and library for evaluating and red-teaming LLM apps and agents

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

Open-source, OpenTelemetry-native evals and tracing for AI agents

Open-source framework for large language model evaluations, built by the UK AI Security Institute

Toolkit for evaluating LLM applications with objective metrics, test data generation and feedback loops

Platform for agent observability and evals: trace agents, score outputs and find patterns in production