Skip to content
Agentmart
Submit a tool

judge-study-aggregation

Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g.

Skill by serhiipriadko2-sys

IndexedNOASSERTION
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/serhiipriadko2-sys-judge-study-aggregation

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g. the unified-1000 bank) under the Independent Judge protocol — stratified per-family aggregates, missingness rates, hard-failure propagation (never averaged into scores), descriptive effect sizes with descriptive intervals, swap_consistency across pairs, and claim-ceiling enforcement (benchmark-local L3 only, never model-family L5). Trigger when the judge must summarize a task bank, produce a study claim, compare candidates across a corpus, or compute study statistics. Requires EXT31 in the runtime slot when working inside the ChatGPT Project.

Use cases: productivity

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found
Runs as
Python package

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/judge-study-aggregation

What's inside

Skill name
judge-study-aggregation
Description
Aggregate many evaluation runs into a study-level verdict (estimand L2/L3, e.g. the unified-1000 bank) under the Independent Judge protocol — stratified per-family aggregates, missingness rates, hard-failure propagation (never averaged into scores), descriptive effect sizes with descriptive intervals, swap_consistency across pairs, and claim-ceiling enforcement (benchmark-local L3 only, never model-family L5). Trigger when the judge must summarize a task bank, produce a study claim, compare candidates across a corpus, or compute study statistics. Requires EXT31 in the runtime slot when working inside the ChatGPT Project.
License
NOASSERTION
Instructions
25 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts

Files (4)

  • SKILL.md
  • openai.yaml · agents/
  • runs_schema.md · references/
  • study_stats.py · scripts/

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

More from serhiipriadko2-sys/iskra

Signals

Stars
0
Forks
0
Open issues
8
Last commit (this folder)
Jul 19, 2026 (3 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
NOASSERTION
Repository
github.com/serhiipriadko2-sys/iskra
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
GitHubgithub-graphql

Same skill elsewhere

Copies of this SKILL.md published by others; search shows only one of them.

More from serhiipriadko2-sys

Cite this page

judge-study-aggregation skill. Agent Mart. https://agentmart.dev/skills/serhiipriadko2-sys-judge-study-aggregation (last updated 2026-10-24)