Search
“LLM evaluation”
Showing 1–13 of 13 for “LLM evaluation”
- 0.847score
DeepEval
Confident AI
Open-source LLM evaluation framework, similar to Pytest, for unit testing LLM apps and agents
Observability toolAFreshness: A★ 19.1Kevals - 0.875score
Langfuse
Langfuse (ClickHouse)
Open-source platform for tracing, evaluating and improving AI agents
Observability toolAFreshness: A★ 36.4Ktracing - 0.859score
Opik
Comet
Open-source LLM observability and evaluation platform with agent tracing and test suites
Observability toolAFreshness: A★ 22.9Ktracing - 0.862score
Promptfoo
Promptfoo (OpenAI)
Open-source CLI and library for evaluating and red-teaming LLM apps and agents
Observability toolAFreshness: A★ 26.4Kevals - 0.793score
LangWatch
LangWatch
Open-source platform to trace, test, evaluate and govern every LLM call and AI agent in production
Observability toolAFreshness: A★ 5Kevals - 0.868score
MLflow Tracing
MLflow (Linux Foundation)
Open-source platform for tracing, evaluating and managing prompts for agents, LLMs and ML models
Observability toolAFreshness: A★ 28.5Ktracing - 0.822score
Arize Phoenix
Arize AI
Open-source tool to trace, evaluate and improve AI agents, run locally or self-hosted
Observability toolAFreshness: A★ 12Ktracing - 0.582score
Evidently
Evidently AI
Open-source framework to evaluate, test and monitor ML and LLM systems
Observability toolAFreshness: Aevals - 0.557score
LangSmith
LangChain
Tracing, evaluation and monitoring for LLM apps and agents, with SDKs for several languages
Observability toolAFreshness: A★ 17tracing - 0.594score
Arize AX
Arize AI
AI engineering platform for observing, evaluating and improving AI agents
Observability toolAFreshness: Atracing - 0.697score
AgentOps
AgentOps
Observability and dev-tool platform for building, evaluating and monitoring AI agents
Observability toolCFreshness: C★ 5.9Ktracing - 0.595score
Fiddler AI
Fiddler AI
Control plane for enterprise AI agents covering monitoring, evals, enforcement and governance
Observability toolAFreshness: Atracing - 0.581score
Giskard
Giskard
Open-source Python library for evals, red teaming and test generation for agentic systems
Observability toolAFreshness: Aevals