“monitoring”

APM-based AI monitoring for end-to-end visibility into the performance, cost and quality of LLM apps

AI observability in Sentry for tracing and debugging agent runs, tool calls, token usage and errors

Platform for developers of AI chatbots and LLM apps, covering monitoring, prompts and analytics

Control plane for enterprise AI agents covering monitoring, evals, enforcement and governance

Continuous-improvement stack for agents: monitor behavior, detect failures and validate fixes

Monitor the performance, usage, cost and guardrails of LLM and agentic AI apps in Elastic Observability

Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages

Observability and dev-tool platform for building, evaluating and monitoring AI agents

Open-source LLM observability and evaluation platform with agent tracing and test suites

Monitoring platform for AI agents that discovers silent agent failures in production

Agent observability platform for tracing, evaluating, monitoring and improving AI agents

Platform for monitoring, troubleshooting and evaluating LLM applications and AI agents

Full-stack observability for AI applications, LLMs and agents, covering performance, cost, quality and compliance

Open-source agent harness engineering platform with OpenTelemetry tracing, evals and guardrails

Connects prompts, model calls, tool use, cost and failures to help debug LLM apps and agents in production