Skip to content
Agentmart
Submit a tool

auto-grill

Stress-tests a plan against the real codebase without manual tab-switching.

Skill by bymatej

IndexedMIT
Write a review

Chalk Labs

Need help deploying auto-grill?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/bymatej-auto-grill

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Stress-tests a plan against the real codebase without manual tab-switching. A griller agent produces adversarial questions blind to the code; a researcher agent answers them by actually reading models, migrations, tests, and context files; human judgment calls surface as A/B/C prompts. Use this whenever someone pastes a plan and wants it stress-tested, says "grill my plan", wants to find gaps before implementing, or invokes /auto-grill. Also trigger when the user says things like "does my design hold up?", "what am I missing?", or "sanity check this plan".

Use cases: design, productivity, agent-building

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/auto-grill

What's inside

Skill name
auto-grill
Description
Stress-tests a plan against the real codebase without manual tab-switching. A griller agent produces adversarial questions blind to the code; a researcher agent answers them by actually reading models, migrations, tests, and context files; human judgment calls surface as A/B/C prompts. Use this whenever someone pastes a plan and wants it stress-tested, says "grill my plan", wants to find gaps before implementing, or invokes /auto-grill. Also trigger when the user says things like "does my design hold up?", "what am I missing?", or "sanity check this plan".
License
MIT
Instructions
162 lines in SKILL.md · view on GitHub

Files (1)

  • SKILL.md

SKILL.md (first lines)

# Auto-Grill

Replaces the manual two-tab workflow: grill-me in one tab, codebase Q&A in
another. The griller stays adversarially blind to the code so questions are
generated from pure reasoning, not confirmation bias.

## Invocation

```
/auto-grill                              # prompts for plan
/auto-grill 15                           # 15 questions instead of 10
/auto-grill @path/to/file.py             # attach file as extra context
/auto-grill @plan.md @models.py 12       # multiple context files + count
```

`@<path>` args are read and passed to the researcher (not the griller).
A bare number sets the question count. Everything else is the plan inline.

---

## Step 1: Gather inputs

Parse args:
- `@<path>` tokens - read each file, label it by filename, collect as CONTEXT
- a bare integer - question count (default: 10)
- anything else - the plan

If no plan is found in args, ask the user to paste it.

Tell the griller only which context filenames exist - not their content.
This preserves the adversarial separation: the griller cannot see the answers.

---

## Step 2: Griller agent

Spawn a general-purpose agent with no codebase access. Give it the plan
and the list of context filenames (not contents).

The griller's job is adversarial: generate questions that would embarrass the
plan. It should not look anything up - only reason from the plan text.

```
You are a senior engineer adversarially reviewing a plan. Generate [N] hard
questions that stress-test assumptions, expose ambiguities, probe edge cases,
and challenge design decisions. Do NOT search the codebase or look anything
up - generate questions from pure reasoning about the plan.

Rules:
- Specific and concrete only (not "have you considered edge cases?")
- Cover: data model assumptions, state machine transitions, concurrency,
  failure modes, backwards compatibility, missing requirements,
  performance at scale, security boundaries
- Tag each question: [CODE] if answerable by reading code,
  [JUDGMENT] if it needs a human decision, [BOTH] if it needs both
- Number each question 1 through N
- Questions only - no answers

[If context files were attached]:
Note: reviewers have access to these files: [list filenames only]

Plan:
[PLAN TEXT]
```

---

## Step 3: Researcher agent

Spawn an Explore agent (or general-purpose with full tools). Give it the
[CODE] and [BOTH] questions, the plan, the working directory, and any
attached context files.

Skip [JUDGMENT]-only questions here - they go directly to the user in Step 4.

```
You are answering adversarial review questions about a plan. For each
question, search the actual codebase to find the real answer. Read models,
migrations, existing code, tests, and context files - do not guess.

Output format for each question:
**Q[N]**: [question text]
**Answer**: [what you found in code/docs/context]
**Confidence**: HIGH / MEDIUM / LOW
**Gap**: YES / NO
**Notes**: [if confidence < HIGH or gap is YES, explain what is missing
           or contradictory]

Codebase root: [working directory]

Check these context files first if they exist:
- lib/ai-codebase-context/_common/index.md
- lib/ai-codebase-context/_common/state-machines.md
- CLAUDE.md

[If attached context]:
Additional context provided by user:
[CONTEXT FILE CONTENTS WITH FILENAMES AS HEADERS]

Questions to answer:
[GRILLER OUTPUT - CODE and BOTH questions only]

Plan:
[PLAN TEXT]
```

---

## Step 4: Human decision points

After the researcher returns, collect every question that needs human judgment:
- All [JUDGMENT]-tagged questions
- All [BOTH] questions where researcher returned Confidence < HIGH or Gap = YES

For each decision, use `AskUserQuestion` (or plain-text prompt if unavailable):
- Header: short label, e.g. "Retry strategy"
- Question: the griller's exact question
- Options: 2-4 concrete choices derived from the plan and researcher findings,
  plus "Other / I'll explain"

From bymatej/skills, MIT.

Signals

Stars
0
Forks
0
Open issues
0
Last commit (this folder)
May 20, 2026 (5 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
MIT
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

More from bymatej

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get auto-grill running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying auto-grill?

CallGet help
Cite this page

auto-grill skill. Agent Mart. https://agentmart.dev/skills/bymatej-auto-grill (last updated 2026-10-24)