Skip to content
Agentmart
Submit a tool

Alternatives to bmad-eval

bmad-eval is an agent skill by bmad-code-org: Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a…. If it doesn't fit your setup, these 12 agent skills cover similar ground. They are ordered by how closely they match bmad-eval and by our rank, which weighs adoption, freshness and documentation; money never changes the order. agent-evals leads the list (open source). 1 of them is published by the company behind the product. Each entry shows data reasons to switch, and you can open a side-by-side comparison with bmad-eval.

Updated Oct 26, 2026 · Built from catalog data; how we rank and grade

You're replacing

bmad-eval

Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a…

12 alternatives

Ordered by how closely each matches bmad-eval (shared product, category or stated alternative) and by rank.

  1. 1
    agent-evals

    devops-skills

    Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates.

    • Open source

    ★ 48.4KLast active Oct 24, 2026Claude Code, Claude apps, Codex, Cursor +6Compare →

  2. 2
    eval-improve

    malloydata

    Make the smallest safe edit that closes a diagnosed gap the model repo owns: a Malloy model edit, or a package skill under skills/.

    • Open source

    ★ 118Last active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  3. 3
    eval-answer

    malloydata

    Score one analytical answer against a verified golden, and score which of the entities the golden depends on retrieval delivered to the answerer.

    • Open source

    ★ 118Last active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  4. 4
    mllm-eval

    Aperivue

    Use when designing or auditing how an LLM or multimodal LLM is evaluated on a clinical task (report generation, VQA, text extraction).

    • Open source
    • Supports bash

    ★ 349Last active Oct 4, 2026Claude Code, Claude apps, Codex, Cursor +6

  5. 5
    decision-eval

    avelikiy

    Spawns the decision-scorer agent after architect proposes 2+ variants in an ADR.

    • Open source

    ★ 105Last active Oct 23, 2026Claude Code, Claude apps, Codex, Cursor +6

  6. 6
    eval-harness

    sangrokjung

    Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles

    • Open source

    ★ 863Last active Aug 25, 2026Claude Code, Claude apps, Codex, Cursor +6

  7. 7
    eval

    PrimeIntellect-ai

    Launch and monitor prime-rl evals — the `uv run eval` entrypoint, its config and CLI shorthands, run directory, resume, logs and metrics.

    • Open source

    ★ 2.2KLast active Oct 23, 2026Claude Code, Claude apps, Codex, Cursor +6Compare →

  8. 8
    suede-ai-eval

    JasonColapietro

    Suede AI eval design and coverage audit: AI-SPEC, failure-mode rubric with severity scoring, concrete pass/fail eval cases, coverage and infrastructure…

    • Open source

    ★ 125Last active Oct 24, 2026Claude Code, Claude apps, Codex, Cursor +6

  9. 9
    expo-skill-eval

    expo

    Evaluate Expo skills in this repo end-to-end - trigger accuracy, generated code quality, and runtime screenshots on iOS simulator and Android emulator via…

    • Open source
    • Supports bash

    ★ 3KLast active Jul 7, 2026Claude Code, Claude apps, Codex, Cursor +6

  10. 10
    wandb-eval-tables

    wandbOfficial

    Convert W&B Table artifacts into non-destructive EvalTable previews with scan-first planning, typed input/output/score columns, bounded batches, verification…

    • Published by the vendor
    • Open source

    ★ 71Last active Aug 6, 2026Claude Code, Claude apps, Codex, Cursor +6

  11. 11
    eval-creator-ci

    pskoett

    [Beta] CI-only eval regression runner using gh-aw (GitHub Agentic Workflows).

    ★ 320Last active Sep 5, 2026Claude Code, Claude apps, Codex, Cursor +6

  12. 12
    eval-creator

    pskoett

    [Beta] Creates permanent eval cases from promoted learnings and runs regression checks against them.

    ★ 320Last active Sep 5, 2026Claude Code, Claude apps, Codex, Cursor +6

Related