validate-rubrics

Apply adversarial stress-testing to identify and fix vulnerabilities in evaluation rubrics

IndexedMIT

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/ankh-studio-validate-rubrics

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

Apply adversarial stress-testing to identify and fix vulnerabilities in evaluation rubrics

Use cases: testing

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools: No tools found
Secrets: None asked for
Install scripts: None found

Network hosts it talks to 1

codeload.github.com · found in install command

Files it touches

~/.claude/skills/validate-rubrics

What's inside

Skill name: validate-rubrics
Description: Apply adversarial stress-testing to identify and fix vulnerabilities in evaluation rubrics
License: MIT
Instructions: 31 lines in SKILL.md · view on GitHub

Files (1)

SKILL.md

SKILL.md (first lines)

# Validate Rubrics

Apply adversarial stress-testing to identify and fix vulnerabilities in evaluation rubrics.

## Process

1. **Generate Edge Cases**: Create challenging artifacts that could break scoring logic
2. **Adversarial Analysis**: Attack the rubric:
   - Identify 5+ ways rubric could produce wrong/incomplete/biased results
   - Rate severity (Critical/High/Medium/Low) and likelihood (Likely/Possible/Unlikely)
   - Propose specific rubric revisions for each issue
   - Provide hardened version with all improvements
3. **Validate**: Test hardened rubric against edge cases
4. **Assess**: Confirm reliability and document limitations

## Usage

```bash
node scripts/apply-pack.js validate-rubrics --path <rubric-file>
```

## Example

```bash
node scripts/apply-pack.js validate-rubrics --path rubrics/prompt.md
```

Be aggressive - this is stress-testing, not validation. Focus on scenarios where rubric might fail
under adversarial conditions.

From Ankh-Studio/copilot-enterprise-eval-plugin, MIT.

Signals

Stars: 0
Forks: 0
Open issues: 0
Last commit (this folder): Mar 13, 2026 (7 months ago)
Last release: Mar 14, 2026 (7 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License: MIT
Repository: github.com/Ankh-Studio/copilot-enterprise-eval-plugin
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: GitHub github-graphql

More from Ankh-Studio

Cite this page

validate-rubrics skill. Agent Mart. https://agentmart.dev/skills/ankh-studio-validate-rubrics (last updated 2026-10-24)