Skip to content
Agentmart
Submit a tool

agentic-evals

Agentic evaluation of skills using multi-trial fixtures, deterministic command assertions, trajectory checks, safety constraints, and evidence-backed…

Skill by grahama1970

IndexedLicense unknown
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/grahama1970-agentic-evals

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Agentic evaluation of skills using multi-trial fixtures, deterministic command assertions, trajectory checks, safety constraints, and evidence-backed readiness scoring. Use when users ask for agentic evals, multi-trial skill evaluation, skill trajectory validation, or readiness scoring for a skill workflow.

Use cases: productivity

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found
Runs as
Python package

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/agentic-evals

What's inside

Skill name
agentic-evals
Description
Agentic evaluation of skills using multi-trial fixtures, deterministic command assertions, trajectory checks, safety constraints, and evidence-backed readiness scoring. Use when users ask for agentic evals, multi-trial skill evaluation, skill trajectory validation, or readiness scoring for a skill workflow.
License
unknown
Instructions
452 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts

Files (25)

  • .gitignore
  • DESIGN.md
  • README.md
  • REMEDIATION_LOOP.md
  • SKILL.md
  • pyproject.toml
  • run.sh
  • sanity.sh
  • issue1631_deterministic_proof.py · scripts/
  • issue1631_live_e2e.py · scripts/
  • claims.py · src/
  • coverage.py · src/
  • domain_profiles.py · src/
  • evidence.py · src/
  • journeys.py · src/
  • provenance.py · src/
  • regressions.py · src/
  • remediation.py · src/
  • runner.py · src/
  • harden_selftests.sh · tests/
  • test_compliance_tier_gate.py · tests/
  • test_execution_provenance.py · tests/
  • test_journeys.py · tests/
  • test_remediation.py · tests/
  • uv.lock

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

Signals

Stars
0
Forks
0
Open issues
0
Last commit (this folder)
Sep 24, 2026 (1 month ago)

From GitHub (fetched Oct 24, 2026).

Details

License
License unknown
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

More from grahama1970

Cite this page

agentic-evals skill. Agent Mart. https://agentmart.dev/skills/grahama1970-agentic-evals (last updated 2026-10-24)