Skip to content
Agentmart
Submit a tool

paper-reviewer

Comprehensive pre-submission review orchestrator.

Skill by astoreyai

IndexedMIT★ 5
Write a review

Chalk Labs

Need help deploying paper-reviewer?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/astoreyai-paper-reviewer

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Comprehensive pre-submission review orchestrator. Coordinates methodology checks, bias detection, AI text detection, statistical validation, and reporting guideline compliance for journal submissions.

Use cases: security, research

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.

Tools
No tools found
Secrets
None asked for
Install scripts
None found

Network hosts it talks to 1

  • codeload.github.com · found in install command

Files it touches

  • ~/.claude/skills/paper-reviewer

What's inside

Skill name
paper-reviewer
Description
Comprehensive pre-submission review orchestrator. Coordinates methodology checks, bias detection, AI text detection, statistical validation, and reporting guideline compliance for journal submissions.
License
MIT
Instructions
119 lines in SKILL.md · view on GitHub

Files (1)

  • SKILL.md

SKILL.md (first lines)

# Paper Reviewer

Comprehensive pre-submission review for journal manuscripts. Orchestrates multiple specialized skills from research-assistant to ensure publication readiness.

## When to Use

- Before submitting papers to journals
- After completing systematic reviews
- When preparing dissertation chapters for committee
- For quality assurance on research manuscripts

## Features

1. **AI Text Detection** - Identify LLM-generated patterns
2. **Methodology Assessment** - Verify research design rigor
3. **Bias Detection** - Apply RoB 2, ROBINS-I, QUADAS-2 frameworks
4. **Statistical Validation** - Check assumptions, effect sizes, power analysis
5. **Reporting Compliance** - Validate CONSORT, PRISMA, STROBE guidelines
6. **Citation Integrity** - Verify references, check for retractions
7. **Reproducibility Audit** - Assess code/data availability

## Usage

```
Review the manuscript at ~/Documents/submissions/AffectivePrompting/ for journal submission.
This is a systematic review targeting IEEE Transactions.
```

## Review Pipeline

### Phase 1: Triage
- Classify paper type (RCT, systematic review, observational, etc.)
- Identify target journal requirements
- List available files

### Phase 2: AI Detection
- Run ai-check skill
- Flag sections with AI patterns >30%
- Generate authenticity report

### Phase 3: Methodology
- Assess study design appropriateness
- Verify protocol adherence
- Check randomization/blinding (if applicable)

### Phase 4: Risk of Bias
- Apply appropriate RoB tool
- Document domain-by-domain assessment
- Generate traffic light visualization

### Phase 5: Statistical Validation
- Verify assumption testing
- Check effect size reporting
- Validate power analysis

### Phase 6: Reporting Compliance
- Apply appropriate checklist (CONSORT/PRISMA/STROBE)
- Calculate compliance percentage
- List missing items

### Phase 7: Citation Audit
- Verify all references
- Check for retractions
- Validate DOIs

### Phase 8: Reproducibility
- Check code availability
- Verify data accessibility
- Assess documentation completeness

## Output

Generates comprehensive review report:
- Executive summary with overall assessment
- Section-by-section findings
- Priority-ranked revision checklist
- Detailed appendices

## Paper Type-Specific Workflows

### Systematic Reviews
- PRISMA 2020 compliance
- AMSTAR 2 quality assessment
- Meta-analysis validation

### RCTs
- CONSORT compliance
- RoB 2 bias assessment
- ITT/per-protocol analysis check

### Observational Studies
- STROBE compliance
- ROBINS-I bias assessment
- Confounding control verification

## Integration

Uses research-assistant skills:
- ai-check
- risk-of-bias
- hypothesis-test
- effect-size
- power-analysis
- publication-prep
- citation-format
- prisma-diagram

## Configuration

Default thresholds (can override):
- AI detection: 30% (flag if higher)
- Reporting compliance: 85% minimum
- All 8 phases enabled by default

---

*Part of ai_scientist research workflow automation*

From astoreyai/claude-skills, MIT.

More from astoreyai/claude-skills

Signals

Stars
5
Forks
1
Open issues
0
Last commit (this folder)
Jan 1, 2026 (10 months ago)

From GitHub (fetched Oct 24, 2026).

Details

License
MIT
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

More from astoreyai

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get paper-reviewer running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying paper-reviewer?

CallGet help
Cite this page

paper-reviewer skill. Agent Mart. https://agentmart.dev/skills/astoreyai-paper-reviewer (last updated 2026-10-24)