“LLM evaluation”

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Open-source platform for tracing, evaluating and improving AI agents

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source CLI and library for evaluating and red-teaming LLM apps and agents

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

Open-source platform for tracing, evaluating and managing prompts for agents, LLMs and ML models

Open-source tool to trace, evaluate and improve AI agents, run locally or self-hosted

Open-source framework to evaluate, test and monitor ML and LLM systems

Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages

AI engineering platform for observing, evaluating and improving AI agents

Observability and dev-tool platform for building, evaluating and monitoring AI agents

Control plane for enterprise AI agents covering monitoring, evals, enforcement and governance

Open-source Python library for evals, red teaming and test generation for agentic systems

Retool platform for building agents that combine code, LLM decisions and human review, connected to external systems of record