“testing”

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source holistic solution for AI and ML validation: testing, CI and monitoring

Automated prompt injection scanner for custom LLM applications, with white-box and black-box testing modes.

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

Toolkit for evaluating LLM applications with objective metrics, test data generation and feedback loops

Open-source framework to evaluate, test and monitor ML and LLM systems

Open-source tool that runs dynamic attacks against a GenAI app's system prompt to help harden it.

Open-source Python framework from Microsoft for finding risks in generative AI systems through red teaming.

Open-source Python library for evals, red teaming and test generation for agentic systems

Open-source LLM red teaming framework that simulates attacks to find vulnerabilities in AI apps and agents.

Python tool that scans MCP servers and their tools for security findings using YARA, LLM and AI Defense analysis.

Open-source LLM vulnerability scanner that probes models and apps for prompt injection, data leakage and jailbreaks.

Automated LLM fuzzer that tries jailbreak attacks against models and LLM APIs, including your own REST API.