judgeval vs LangGraph
judgeval and LangGraph are both agent frameworks for Python. judgeval is published by JudgmentLabs and LangGraph by LangChain. On GitHub, LangGraph has 43,823 stars and judgeval has 1,070. Both were last active in Oct 2026. The table lines up where they differ (publisher, license, GitHub stars and weekly downloads) and has the install commands for both. Everything here comes from the listings' public sources and is refreshed daily. judgeval describes itself as: Python SDK for tracing agents and scoring their traces with prompt-based judges, to find failures in production. LangGraph: Low-level Python orchestration framework for long-running stateful agents, with durable execution, human review points and short- and long-term memory. Licenses: judgeval Apache-2.0, LangGraph MIT.
Updated Oct 24, 2026 · Built from catalog data; how we rank and grade
judgeval
JudgmentLabs
Python SDK for tracing agents and scoring their traces with prompt-based judges, to find failures in production.
LangGraph
LangChain
Low-level Python orchestration framework for long-running stateful agents, with durable execution, human review points and short- and long-term memory.
Who should pick which
- Pick LangGraph if you need several agents working together.
- LangGraph has the larger community: 43,823 GitHub stars against 1,070.
From listing data only. We don't pick a winner on security beyond the grades; read how grades work.
Side by side
| Fact | judgeval | LangGraph |
|---|---|---|
| Type | Harness | Harness |
| Publisher | JudgmentLabs | LangChain |
| License | Apache-2.0 | MIT |
| Pricing | Not stated | Not stated |
| Runs | Not stated | Not stated |
| Auth | Not stated | Not stated |
| Hosts supported | Not stated | Not stated |
| Tools | Not listed yet | Not listed yet |
| Security grade | –Security: not graded yet | –Security: not graded yet |
| Freshness grade | AFreshness: A | AFreshness: A |
| GitHub stars | 1,070 | 43,823 |
| Weekly downloads | 77,683 | 13,114,431 |
| Last release | Oct 21, 2026 | Oct 24, 2026 |
| Last activity | Oct 23, 2026 | Oct 24, 2026 |
Facts from each listing's public sources, checked daily. Tool lists arrive with tool scans.
Install
judgeval
pip install judgeval
LangGraph
pip install langgraph
Also consider
- 0.853score
LlamaIndex
LlamaIndex
Open-source Python toolkit for RAG and agents over your own data, with event-driven workflows and 300+ integration packages.
HarnessAFreshness: A★ 52.6K↓ 1.4M/wk - 0.753score
LangChain
LangChain
Python framework of interoperable components and integrations for building agents and LLM apps, with LangGraph and Deep Agents layered above it.
HarnessAFreshness: A★ 148.4K↓ 37.3M/wk - 0.732score
CrewAI
CrewAI
Open-source Python framework for multi-agent workflows, with role-based Crews and event-driven Flows.
HarnessAFreshness: A★ 60.1K↓ 644.6K/wk
Questions
- Is judgeval or LangGraph more popular?
- LangGraph has more GitHub stars (43,823 against 1,070). Stars measure attention, not quality, so check freshness and docs too.
- Are judgeval and LangGraph open source?
- Yes: judgeval is Apache-2.0 and LangGraph is MIT.
Related
Cite this page
judgeval vs LangGraph. Agent Mart. https://agentmart.dev/compare/judgeval-vs-langgraph (last updated 2026-10-24)