Observability & evals

AI observability and eval engineering platform where offline evals become production guardrails

Google Cloud service that screens LLM prompts and responses for prompt injection, sensitive data and harmful content.

AI security platform covering discovery, assessment, runtime protection and governance of AI apps and agents

AI quality platform for developers that builds evaluators, guardrails and monitoring for LLM applications

Enterprise agent security and governance platform covering agent discovery, guardrails, evals and traces

Full-stack observability for AI applications, LLMs and agents, covering performance, cost, quality and compliance

Open-source framework to evaluate, test and monitor ML and LLM systems

Security platform for AI covering asset discovery, supply chain checks, attack simulation and runtime defense.

Meta's open classifier models that detect prompt injection and jailbreak attacks on LLM inputs.

Open-source Python library for evals, red teaming and test generation for agentic systems

Simulation and evaluation platform that tests voice and text agents with synthetic users

AI observability in Sentry for tracing and debugging agent runs, tool calls, token usage and errors

OpenTelemetry-native observability for LLMs, vector databases, GPUs, MCP servers and AI evaluations in Grafana Cloud

Platform to discover, protect and govern AI agents and AI interactions, with runtime enforcement

End-to-end platform for simulating, evaluating and observing AI agents and applications

Attack-led AI security platform that finds, validates and helps fix vulnerabilities in AI systems and agents.

Finds AI assets and risks, red teams models and agents, and blocks threats to AI apps in real time.

Guards AI models, apps and agents against prompt injection, data leakage and harmful outputs.

Enterprise service for objective evaluation of generative AI models using adaptive and static rubrics

Active behavior assessment and runtime enforcement for AI agents, built on adversarial red teaming research.

Automated red teaming for AI apps and agents that tests for safety, security and responsible AI failures.

Agent security and governance platform that controls agent behavior at runtime across endpoint, SaaS and cloud.

Platform for governing AI tool use, securing agents and protecting AI applications in real time

Enterprise platform for AI asset discovery, red teaming and runtime security across agentic workflows and MCP.