“Testing”

Open-source LLM observability and evaluation platform with agent tracing and test suites

Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production

Cloud-based autonomous software engineer that takes tickets, writes and tests code in its own browser, and opens pull requests

AI governance platform to discover, test, monitor and govern AI systems and enforce controls

Simulation platform for building frontier AI agents, testing them on realistic scenarios with evals

AWS's AI assistant for developers that chats, writes and tests code, upgrades Java and .NET apps, and helps operate AWS

AWS agent that reviews code for release readiness, tests releases and investigates production incidents across AWS, multicloud and on-prem.

Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents

No-code visual tool for creating, testing and refining Rasa conversational assistants, with export to code

Open-source framework to evaluate, test and monitor ML and LLM systems

Open-source autonomous pentesting agents that run your app, find vulnerabilities and validate them with working proofs of concept.

AWS's spec-driven coding agent that turns prompts into requirements, designs and tasks, available in IDE, CLI, web and mobile

Low-code Salesforce builder for creating, testing and optimizing agents that use Salesforce data, Flows, Apex and MuleSoft APIs

Test, monitor and self-improve voice agents with simulation, red teaming and production monitoring

Headless Chrome on Cloudflare's global network for automation, scraping, screenshots and testing.

Open-source durable execution platform for orchestrating async code, background jobs and agents.

Open-source Python library for evals, red teaming and test generation for agentic systems

Open-source authorization decision point and management platform for apps, APIs and AI agents

AI pull request reviewer that indexes the whole repository as a graph and uses several agents per review

Cloud platform to build, deploy and distribute MCP servers and MCP apps for ChatGPT and Claude.

Guardrails, evaluation and pre-production red teaming for AI agents, RAG apps and chatbots.

Hosted platform to deploy, observe and manage AI agents built with the open-source Mastra framework.

Monitoring platform for AI agents that discovers silent agent failures in production

Builds mobile apps, sites and tools from plain-language descriptions, with credit-based plans