93 listed

Observability & evals

Tracing, evals, guardrails and red-teaming tools for agents in production. Each page links to the vendor's own docs and pricing; compliance claims are what the vendor states, with the page it came from.

Showing 1–8 of 8

0.875score
Langfuse
Langfuse (ClickHouse)
Open-source platform for tracing, evaluating and improving AI agents
Observability toolAFreshness: A★ 36.4Ktracing
0.859score
Opik
Comet
Open-source LLM observability and evaluation platform with agent tracing and test suites
Observability toolAFreshness: A★ 22.9Ktracing
0.778score
Pydantic Logfire
Pydantic
Observability platform for AI apps covering model calls, agent steps, API requests and database queries in one trace
Observability toolAFreshness: A★ 4.5Ktracing
0.758score
Laminar
Laminar
Open-source observability platform for AI agents that detects failures and supports evals
Observability toolAFreshness: A★ 3.4Ktracing
0.716score
W&B Weave
Weights & Biases (CoreWeave)
Toolkit for tracing and evaluating AI agents and LLM apps, built by Weights & Biases
Observability toolAFreshness: A★ 1.1Ktracing
0.697score
AgentOps
AgentOps
Observability and dev-tool platform for building, evaluating and monitoring AI agents
Observability toolCFreshness: C★ 5.9Ktracing
0.594score
PromptLayer
PromptLayer
Collaboration layer for AI engineering teams: prompt management, agent observability and evals
Observability toolAFreshness: Atracing
0.587score
New Relic AI Monitoring
New Relic
APM-based AI monitoring for end-to-end visibility into the performance, cost and quality of LLM apps
Observability toolAFreshness: Atracing