Observability & evals

AI router with built-in observability, automated evals and red-teaming for agent runs

Platform for monitoring, troubleshooting and evaluating LLM applications and AI agents

AI observability and eval engineering platform where offline evals become production guardrails

Full-stack observability for AI applications, LLMs and agents, covering performance, cost, quality and compliance

AI observability in Sentry for tracing and debugging agent runs, tool calls, token usage and errors

OpenTelemetry-native observability for LLMs, vector databases, GPUs, MCP servers and AI evaluations in Grafana Cloud

End-to-end platform for simulating, evaluating and observing AI agents and applications

Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages

Traces every LLM call in your AI product, with prompt, tokens, cost, latency and the user who triggered it