Observability & evals

Connects prompts, model calls, tool use, cost and failures to help debug LLM apps and agents in production

Open-source workspace where teams build AI agents by chatting and run them in Slack, WhatsApp or Telegram

Enterprise agent security and governance platform covering agent discovery, guardrails, evals and traces

Open-source framework to evaluate, test and monitor ML and LLM systems

Open-source Python library for evals, red teaming and test generation for agentic systems

Platform for agent observability and evals: trace agents, score outputs and find patterns in production

Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages

Traces every LLM call in your AI product, with prompt, tokens, cost, latency and the user who triggered it

Microsoft AI service that detects harmful text and image content and screens user input for prompt attacks.