Skip to content
Agentmart
Submit a tool

create-test

Define or implement regression proof: test strategy, black-box or integration tests, KPIs, thresholds, audits, or missing tests.

Skill by reidemeister94

IndexedMIT★ 12
Write a review

Chalk Labs

Need help deploying create-test?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/reidemeister94-create-test

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Define or implement regression proof: test strategy, black-box or integration tests, KPIs, thresholds, audits, or missing tests.

Use cases: testing

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/create-test

Tools it pre-approves 7

From allowed-tools in SKILL.md: the agent may use these without asking you each time.

  • Glob,
  • Grep,
  • Read,
  • Bash,
  • Edit,
  • Write,
  • AskUserQuestion

What's inside

Skill name
create-test
Description
Define or implement regression proof: test strategy, black-box or integration tests, KPIs, thresholds, audits, or missing tests.
License
MIT
Allowed tools
Glob,, Grep,, Read,, Bash,, Edit,, Write,, AskUserQuestion
Instructions
61 lines in SKILL.md · view on GitHub

Before installing

  • Pre-approves some shell commands

Files (2)

  • SKILL.md
  • integration-patterns.md · references/

SKILL.md (first lines)

# Create test

Start with the user need or business rule that must always hold, not files, coverage, or internal calls.
Inspect for facts; ask only for business decisions that cannot be discovered.

## Define the regression contract

Establish:

- actors, goals, and externally observable outcomes;
- business rules and invariants that must never change;
- critical paths and relevant rejection, timeout, retry, permission, concurrency, and partial-failure cases;
- the current baseline and every intended behavior change;
- KPIs with window, data set, acceptable variance, and justified pass or fail threshold;
- systems crossed, production-like data needs, and evidence the available environment can provide.

Never invent a metric or threshold; record the gap.
Match the proof's inputs and environment to the context it claims to model.
A subprocess that represents normal runtime must not inherit test-only environment variables.

## Choose the proof

Prefer the highest reliable boundary:

1. black-box tests through the public API, UI, job, event, or CLI;
2. deep integration with the real database, queue, connector, or protocol;
3. contract, replay, property, or characterization tests for narrower risks;
4. unit tests for isolated rules where a wider test adds no confidence.

Mock only beyond the verified boundary.
For database or migration work, read [integration patterns](references/integration-patterns.md).
When proving a process manager, worker, container entrypoint, or deployed artifact, use the real container or operating-system image.
Verify worker replacement, signal handling, and graceful shutdown only when those boundaries apply.

For strategy or audit only, return the contract, prioritized scenarios, proof method, and blind spots.
Judge tests by failures caught, not assertion or coverage counts.
Ask which states the proof covers and whether it includes the most fragile states.

## Prove a refactor differently

A refactor keeps behavior. Capture a characterization baseline and observe it green on the unchanged code and after the refactor.
Never break working behavior to watch a refactor test fail.
If the baseline cannot run, name what is missing instead of lowering the proof standard.

## Prove a performance claim

A performance claim needs a measurement that could contradict it.
Measure unchanged and changed code with the same tool, environment, and data set.
Name the tool and workload. Report the results and run-to-run spread, not one best run.
For a hard maximum, define valid samples and repetitions before measuring, then judge the worst valid sample.
Measure every required process or worker. Report setup separately from the measured interval.
Profile before optimizing. An unmeasured performance claim remains unproven.

## Implement when asked

Follow project layout and the development loop.
Add the smallest important proof, observe it fail, make approved source changes, then observe it pass.
Assert outcomes, state, events, metrics, and error contracts rather than calls.
Run focused and relevant suites. Report what the evidence proves and what it does not cover.

From reidemeister94/development-skills, MIT.

More from reidemeister94/development-skills

Signals

Stars
12
Forks
1
Open issues
1
Last commit (this folder)
Sep 19, 2026 (1 month ago)
Last release
Sep 20, 2026 (1 month ago)

From GitHub (fetched Oct 24, 2026).

Details

License
MIT
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

More from reidemeister94

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get create-test running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying create-test?

CallGet help
Cite this page

create-test skill. Agent Mart. https://agentmart.dev/skills/reidemeister94-create-test (last updated 2026-10-24)