“testing”

Trust platform for voice and chat agents: pre-launch testing, red teaming and production monitoring

Open-source LLM observability and evaluation platform with agent tracing and test suites

Automated red teaming for AI apps and agents that tests for safety, security and responsible AI failures.

Unified platform to test, protect and govern AI, covering red teaming, runtime guardrails and AI asset discovery.

Open-source holistic solution for AI and ML validation: testing, CI and monitoring

Automated prompt injection scanner for custom LLM applications, with white-box and black-box testing modes.

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

AI governance platform to discover, test, monitor and govern AI systems and enforce controls

Simulation platform for building frontier AI agents, testing them on realistic scenarios with evals

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Toolkit for evaluating LLM applications with objective metrics, test data generation and feedback loops

Open-source framework to evaluate, test and monitor ML and LLM systems

Attack-led AI security platform that finds, validates and helps fix vulnerabilities in AI systems and agents.

Discovers AI agents, MCP servers and skills, tests them adversarially and blocks attacks at runtime.

CLI that discovers agent components on a machine and scans MCP servers and skills for prompt injections.

Framework and registry of evals for testing LLMs and LLM-based systems, maintained by OpenAI

Open-source tool that runs dynamic attacks against a GenAI app's system prompt to help harden it.

Test, monitor and self-improve voice agents with simulation, red teaming and production monitoring

Open-source Python framework from Microsoft for finding risks in generative AI systems through red teaming.

Open-source Python library for evals, red teaming and test generation for agentic systems

Simulation and evaluation platform that tests voice and text agents with synthetic users

Active behavior assessment and runtime enforcement for AI agents, built on adversarial red teaming research.

Enterprise platform for AI asset discovery, red teaming and runtime security across agentic workflows and MCP.

Discovers, tests, secures and governs every AI agent in an organization from one platform.