Skip to content
Agentmart
Submit a tool

Agent skills for LLM evaluation in Claude Code

489 agent skills for LLM evaluation in the catalog list Claude Code as a supported host. These are the 15 that rank highest, ordered by adoption, freshness and documentation. agent-evals, bmad-eval and eval lead the list. Claude Code reads them from .claude/skills/<name>/SKILL.md in the project, or ~/.claude/skills/<name>/ for every project. A skill is a folder with a SKILL.md file; Claude Code loads it when a task matches its description. Every listing links to its source and shows a freshness grade.

Updated Oct 26, 2026 · Built from catalog data; how we rank and grade

How to install in Claude Code

npx skills add <owner>/<repo> --skill <name> -a claude-code

Where it goes: .claude/skills/<name>/SKILL.md in the project, or ~/.claude/skills/<name>/ for every project.

The host's docs describe copying a folder with a SKILL.md into a skills directory; the npx skills command is a third-party shortcut for the same thing.

Each listing page has the exact command for that listing.

Top 15 of 489

  1. 1
    agent-evals

    devops-skills

    Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates.

    • Repository has 48.4K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 48.4KLast active Oct 24, 2026Claude Code, Claude apps, Codex, Cursor +6

  2. 2
    bmad-eval

    bmad-code-org

    Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a…

    • Largest repository here (54,505 stars)
    • Active in the last 30 days
    • Ships helper scripts

    ★ 54.5KLast active Oct 14, 2026Claude Code, Claude apps, Codex, Cursor +6

  3. 3
    eval

    PrimeIntellect-ai

    Launch and monitor prime-rl evals — the `uv run eval` entrypoint, its config and CLI shorthands, run directory, resume, logs and metrics.

    • Repository has 2.2K stars
    • Active in the last 30 days
    • Open source (Apache-2.0)

    ★ 2.2KLast active Oct 23, 2026Claude Code, Claude apps, Codex, Cursor +6

  4. 4
    skill-upper

    alibaba

    Capture and review Agent Skill observations, and create, run, diagnose, or iteratively improve Skill evaluations (evals) with the skill-up CLI.

    • Repository has 1.3K stars
    • Active in the last 30 days
    • Open source (Apache-2.0)

    ★ 1.3KLast active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  5. 5
    check-skill

    UiPath

    Generate and run a coder-eval activation suite for a Claude Code skill.

    • Active in the last 30 days
    • Open source (Apache-2.0)

    ★ 154Last active Oct 21, 2026Claude Code, Claude apps, Codex, Cursor +6

  6. 6
    init

    UiPath

    Set up coder-eval in this repository — scan for what is worth evaluating (Claude Code skills, an MCP server, a CLI), then scaffold a task directory with one…

    • Active in the last 30 days
    • Open source (Apache-2.0)

    ★ 154Last active Oct 21, 2026Claude Code, Claude apps, Codex, Cursor +6

  7. 7
    eval-harness

    sangrokjung

    Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles

    • Open source (MIT)

    ★ 863Last active Aug 25, 2026Claude Code, Claude apps, Codex, Cursor +6

  8. 8
    autoresearch

    pedronauck

    Autonomously optimize any Claude Code skill by running it repeatedly, scoring outputs against binary evals, mutating the prompt, and keeping improvements.

    ★ 641Last active Sep 14, 2026Claude Code, Claude apps, Codex, Cursor +6

  9. 9
    research

    fw-aiOfficial

    Plan Fireworks post-training from a task-shaped goal — recommend a method, cookbook entry, data plan, and eval from what the user already said, ask only…

    • Published by the vendor
    • Active in the last 30 days
    • Open source (Apache-2.0)

    ★ 231Last active Oct 21, 2026Claude Code, Claude apps, Codex, Cursor +6

  10. 10
    eval-improve

    malloydata

    Make the smallest safe edit that closes a diagnosed gap the model repo owns: a Malloy model edit, or a package skill under skills/.

    • Active in the last 30 days
    • Open source (MIT)
    • Ships helper scripts

    ★ 118Last active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  11. 11
    eval-answer

    malloydata

    Score one analytical answer against a verified golden, and score which of the entities the golden depends on retrieval delivered to the answerer.

    • Active in the last 30 days
    • Open source (MIT)
    • Ships helper scripts

    ★ 118Last active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  12. 12
    mllm-eval

    Aperivue

    Use when designing or auditing how an LLM or multimodal LLM is evaluated on a clinical task (report generation, VQA, text extraction).

    • Active in the last 30 days
    • Open source (MIT)
    • Ships helper scripts

    ★ 349Last active Oct 4, 2026Claude Code, Claude apps, Codex, Cursor +6

  13. 13
    clawpathy-autoresearch

    Jay Moore

    Eval-driven skill tuning.

    • Repository has 1.2K stars
    • Open source (MIT)
    • Ships helper scripts

    ★ 1.2KLast active Sep 11, 2026Claude Code, Claude apps, Codex, Cursor +6

  14. 14
    decision-eval

    avelikiy

    Spawns the decision-scorer agent after architect proposes 2+ variants in an ADR.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 105Last active Oct 23, 2026Claude Code, Claude apps, Codex, Cursor +6

  15. 15
    advanced-evaluation

    muratcankoylan

    This skill should be used for advanced LLM evaluation: LLM-as-judge systems, direct scoring, pairwise comparison, rubric calibration, evaluator bias…

    • Repository has 18.2K stars
    • Open source (MIT)
    • Ships helper scripts

    ★ 18.2KLast active Jun 29, 2026Claude Code, Claude apps, Codex, Cursor +6

Related