e2e-matrix-sentinel

Validate cross-platform end-to-end matrix coverage, verify POSIX and Windows driver parity, and enforce offline fixture restamping invariants.

Skill by ianshank

IndexedApache-2.0★ 1

Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/ianshank-e2e-matrix-sentinel

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

Validate cross-platform end-to-end matrix coverage, verify POSIX and Windows driver parity, and enforce offline fixture restamping invariants. Use whenever running end-to-end matrix suites, checking e2e driver parity, or validating matrix coverage freshness.

Use cases: testing

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools: No tools found
Secrets: None asked for
Install scripts: None found
Runs as: Python package

Network hosts it talks to 1

codeload.github.com · found in install command

Files it touches

~/.claude/skills/e2e-matrix-sentinel

What's inside

Skill name: e2e-matrix-sentinel
Description: Validate cross-platform end-to-end matrix coverage, verify POSIX and Windows driver parity, and enforce offline fixture restamping invariants. Use whenever running end-to-end matrix suites, checking e2e driver parity, or validating matrix coverage freshness.
License: Apache-2.0
Instructions: 34 lines in SKILL.md · view on GitHub

Before installing

Ships executable scripts

Agent Skills spec issues

files: referenced but missing: scripts/run_all_e2e.sh, scripts/run_all_e2e.ps1

Files (3)

SKILL.md
evals.json · evals/
sentinel.py · scripts/

SKILL.md (first lines)

# E2E Matrix Sentinel — Cross-Platform E2E & Matrix Coverage Guard

The `e2e-matrix-sentinel` guarantees driver parity, registry matrix completeness, and artifact freshness across Windows and POSIX environments.

## Invariants

1. **Driver Parity (Derive-Never-Allowlist)**: `scripts/run_all_e2e.sh` and `scripts/run_all_e2e.ps1` must declare the exact same set of steps. Any step added to one driver without the other violates cross-platform CI safety.
2. **Matrix Coverage Freshness**: `docs/matrix-coverage.md` must match `python tests/test_matrix_coverage.py --check` at all times.
3. **Offline Restamping Separation**: Live E2E runs (such as `docs/e2e-live-journey.md`) must never be used to restamp offline evaluation fixtures or 0–10 score cells (`OfflineRestampConfig`).

## Usage

### Run All Sentinel Checks
```bash
python skills/e2e-matrix-sentinel/scripts/sentinel.py --check
```

### Verify Driver Parity Specifically
```bash
python -m pytest tests/test_e2e_driver_parity.py -v
```

### Check Matrix Completeness & Coverage Freshness
```bash
python tests/test_matrix_coverage.py --check
```

## Definition of Done

- Driver parity between `run_all_e2e.sh` and `run_all_e2e.ps1` is 100% verified.
- `docs/matrix-coverage.md` is fresh and conforms to the plugin registry census.
- Sentinel CLI passes with exit code 0.

From ianshank/Agents, Apache-2.0.

Signals

Stars: 1
Forks: 0
Open issues: 113
Last commit (this folder): Sep 16, 2026 (1 month ago)

From GitHub (fetched Oct 24, 2026).

Details

License: Apache-2.0
Repository: github.com/ianshank/Agents
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: GitHub github-graphql

More from ianshank

Cite this page

e2e-matrix-sentinel skill. Agent Mart. https://agentmart.dev/skills/ianshank-e2e-matrix-sentinel (last updated 2026-10-24)