93 listed
Observability & evals
Tracing, evals, guardrails and red-teaming tools for agents in production. Each page links to the vendor's own docs and pricing; compliance claims are what the vendor states, with the page it came from.
Showing 1–7 of 7
- 0.859score
Opik
Comet
Open-source LLM observability and evaluation platform with agent tracing and test suites
Observability toolAFreshness: A★ 22.9Ktracing - 0.806score
Helicone
Helicone
AI gateway and LLM observability platform for logging, debugging and routing LLM requests
Observability toolAFreshness: A★ 6.2Ktracing - 0.785score
Latitude
Latitude
Open-source, MIT-licensed platform for observing production AI agents and turning failures into tracked signals
Observability toolAFreshness: A★ 4.7Ktracing - 0.599score
Cekura
Cekura
Test, monitor and self-improve voice agents with simulation, red teaming and production monitoring
Observability toolAFreshness: Aevals - 0.599score
Coval
Coval
Deployment-readiness platform for voice AI agents: simulate calls, evaluate production conversations and add human review
Observability toolAFreshness: Aevals - 0.594score
PromptLayer
PromptLayer
Collaboration layer for AI engineering teams: prompt management, agent observability and evals
Observability toolAFreshness: Atracing - 0.581score
Giskard
Giskard
Open-source Python library for evals, red teaming and test generation for agentic systems
Observability toolAFreshness: Aevals