Skip to content
Agentmart
Submit a tool

bmad-eval

Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a…

Skill by bmad-code-org

IndexedNOASSERTION★ 54,505
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/bmad-code-org-bmad-eval

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.

Use cases: testing, agent-building, llm-evaluation

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found
Runs as
Python package

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/bmad-eval

What's inside

Skill name
bmad-eval
Description
Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.
License
NOASSERTION
Instructions
68 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts

Files (20)

  • SKILL.md
  • bmod.toml
  • customize.toml
  • triggers.json · evals/
  • description-optimization.md · references/
  • eval-format.md · references/
  • grader.md · references/
  • harness.md · references/
  • self-improvement.md · references/
  • aggregate_benchmark.py · scripts/
  • convert_cases.py · scripts/
  • eval_common.py · scripts/
  • run_evals.py · scripts/
  • run_triggers.py · scripts/
  • fake_harness.py · scripts/tests/
  • test_aggregate_benchmark.py · scripts/tests/
  • test_convert_cases.py · scripts/tests/
  • test_eval_common.py · scripts/tests/
  • test_run_evals.py · scripts/tests/
  • test_run_triggers.py · scripts/tests/

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

More from bmad-code-org/BMAD-METHOD

Compare and alternatives

Featured in

Signals

Stars
54,505
Forks
6,099
Open issues
64
Last commit (this folder)
Oct 12, 2026 (17 days ago)
Last release
Oct 14, 2026 (14 days ago)

From GitHub (fetched Oct 24, 2026).

Details

License
NOASSERTION
Repository
github.com/bmad-code-org/BMAD-METHOD
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
GitHubgithub-graphql

More from bmad-code-org

Cite this page

bmad-eval skill. Agent Mart. https://agentmart.dev/skills/bmad-code-org-bmad-eval (last updated 2026-10-24)