Skip to content
Agentmart
Submit a tool
This entry duplicates eval-creator-ci, which is the one we list in search.

eval-creator-ci

[Beta] CI-only eval regression runner using gh-aw (GitHub Agentic Workflows).

Skill by pskoett

IndexedLicense unknown★ 320
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/pskoett-eval-creator-ci-1f87dd

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

[Beta] CI-only eval regression runner using gh-aw (GitHub Agentic Workflows). Runs all eval cases in .evals/ on a schedule or per-PR, reports pass/fail results, and can block merges on regressions. Also creates new eval cases from promoted patterns flagged by learning-aggregator-ci. Use when: you want automated regression testing of promoted rules in CI/headless pipelines. For interactive eval creation and runs, use eval-creator.

Use cases: testing, devops

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions: not checked yet.

What's inside

Skill name
eval-creator-ci
Description
[Beta] CI-only eval regression runner using gh-aw (GitHub Agentic Workflows). Runs all eval cases in .evals/ on a schedule or per-PR, reports pass/fail results, and can block merges on regressions. Also creates new eval cases from promoted patterns flagged by learning-aggregator-ci. Use when: you want automated regression testing of promoted rules in CI/headless pipelines. For interactive eval creation and runs, use eval-creator.
License
unknown
Instructions
215 lines in SKILL.md · view on GitHub

Files (2)

  • SKILL.md
  • workflow-example.md · references/

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

More from pskoett/pskoett-ai-skills

Signals

Stars
320
Forks
47
Open issues
0
Last commit (this folder)
Jun 1, 2026 (4 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
License unknown
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

Same skill elsewhere

Copies of this SKILL.md published by others; search shows only one of them.

More from pskoett

Cite this page

eval-creator-ci skill. Agent Mart. https://agentmart.dev/skills/pskoett-eval-creator-ci-1f87dd (last updated 2026-10-24)