Skip to content
Agentmart
Submit a tool
This entry duplicates judge-study-aggregation, which is the one we list in search.

judge-study-aggregation

Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g.

Skill by serhiipriadko2-sys

IndexedNOASSERTION
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/serhiipriadko2-sys-judge-study-aggregation-767f05

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g. the unified-1000 bank) under the Independent Judge protocol — stratified per-family aggregates, missingness rates, hard-failure propagation (never averaged into scores), descriptive effect sizes with descriptive intervals, swap_consistency across pairs, and claim-ceiling enforcement (benchmark-local L3 only, never model-family L5). Trigger when the judge must summarize a task bank, produce a study claim, compare candidates across a corpus, or compute study statistics. Requires EXT31 in the runtime slot when working inside the ChatGPT Project.

Use cases: productivity

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions: not checked yet.

What's inside

Skill name
judge-study-aggregation
Description
Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g. the unified-1000 bank) under the Independent Judge protocol — stratified per-family aggregates, missingness rates, hard-failure propagation (never averaged into scores), descriptive effect sizes with descriptive intervals, swap_consistency across pairs, and claim-ceiling enforcement (benchmark-local L3 only, never model-family L5). Trigger when the judge must summarize a task bank, produce a study claim, compare candidates across a corpus, or compute study statistics. Requires EXT31 in the runtime slot when working inside the ChatGPT Project.
License
NOASSERTION
Instructions
25 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts

Files (4)

  • SKILL.md
  • openai.yaml · agents/
  • runs_schema.md · references/
  • study_stats.py · scripts/

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

More from serhiipriadko2-sys/iskra

Signals

Stars
0
Forks
0
Open issues
8
Last commit (this folder)
Jul 19, 2026 (3 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
NOASSERTION
Repository
github.com/serhiipriadko2-sys/iskra
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
GitHubgithub-graphql

Same skill elsewhere

Copies of this SKILL.md published by others; search shows only one of them.

More from serhiipriadko2-sys

Cite this page

judge-study-aggregation skill. Agent Mart. https://agentmart.dev/skills/serhiipriadko2-sys-judge-study-aggregation-767f05 (last updated 2026-10-24)