Observability & evals

Open-source workspace where teams build AI agents by chatting and run them in Slack, WhatsApp or Telegram

Open-source framework to evaluate, test and monitor ML and LLM systems

Meta's open classifier models that detect prompt injection and jailbreak attacks on LLM inputs.

Open-source Python library for evals, red teaming and test generation for agentic systems

Open-source LLM red teaming framework that simulates attacks to find vulnerabilities in AI apps and agents.

Platform for agent observability and evals: trace agents, score outputs and find patterns in production

Python tool that scans MCP servers and their tools for security findings using YARA, LLM and AI Defense analysis.

Open-source holistic solution for AI and ML validation: testing, CI and monitoring

Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages

Open-source LLM vulnerability scanner that probes models and apps for prompt injection, data leakage and jailbreaks.

Automated LLM fuzzer that tries jailbreak attacks against models and LLM APIs, including your own REST API.

Automated prompt injection scanner for custom LLM applications, with white-box and black-box testing modes.