Skip to content
Agentmart
Submit a tool

capture-eval-issues

Capture noteworthy review violations for the eval framework.

Skill by Codagent-AI

IndexedMIT★ 30
Write a review

Install

Works with Claude Code. Read the repository before you give any tool access to your data.

npx agentmarket install skill/codagent-ai-capture-eval-issues

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md and code. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found
Runs as
Node.js package

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/capture-eval-issues

Tools it pre-approves 3

From allowed-tools in SKILL.md: the agent may use these without asking you each time.

  • Bash,
  • Task,
  • Read

What's inside

Skill name
capture-eval-issues
Description
Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.
License
MIT
Allowed tools
Bash,, Task,, Read
Instructions
18 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts
  • Pre-approves some shell commands

Files (3)

  • SKILL.md
  • judge-prompt.md
  • append-inventory.ts · scripts/

SKILL.md (first lines)

# /capture-eval-issues

Capture noteworthy review violations into the eval inventory.

## Input

This skill receives one or more review JSON file paths as arguments (space-separated).
Example: `/capture-eval-issues validator_logs/review_src_claude@1.0.json validator_logs/review_src_gemini@2.0.json`

## Procedure

1. Read `judge-prompt.md` from this skill's directory
2. Spawn a subagent to judge and capture violations:
   - **Task tool**: `Task` with `subagent_type="general-purpose"`, `model="sonnet"`, `prompt=` judge-prompt content + `"\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>"`
   - The subagent handles everything: reading files, judging, calling the append script
3. Report the subagent's capture summary (the `CAPTURED:` line)

From Codagent-AI/agent-validator, MIT.

More from Codagent-AI/agent-validator

Signals

Stars
30
Forks
2
Open issues
14
Last commit (this folder)
May 13, 2026 (5 months ago)
Last release
Sep 29, 2026 (1 month ago)

From GitHub (fetched Oct 24, 2026).

Details

License
MIT
Repository
github.com/Codagent-AI/agent-validator
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
GitHubgithub-graphql

Same skill elsewhere

Copies of this SKILL.md published by others; search shows only one of them.

More from Codagent-AI

Cite this page

capture-eval-issues skill. Agent Mart. https://agentmart.dev/skills/codagent-ai-capture-eval-issues (last updated 2026-10-24)