“LLM evaluation”

Open-source framework that builds, evaluates and self-improves multi-agent LLM workflows from a goal.

JavaScript and TypeScript framework of interoperable components for building LLM apps and agents, with LangGraph.js and Deep Agents above it.

Ruby library for LLM-powered apps with a unified LLM interface, prompt tools, output parsers, RAG and assistants.

Python interface for running and evaluating agents from several frameworks, with OpenTelemetry traces; now in soft deprecation.

Go framework for AI agents with memory, tool execution, MCP, agent skills, multi-agent patterns and evaluation.

Framework for developing, evaluating and benchmarking web agents on BrowserGym benchmarks, with parallel runs through Ray.