evaluate-rag
Guides evaluation of RAG pipeline retrieval and generation quality.
Skill by Avi977
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/avi977-evaluate-rag
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: testing, data, ml
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.
- Tools
- No tools found
- Secrets
- None asked for
- Install scripts
- None found
Network hosts it talks to 1
codeload.github.com· found in install command
Files it touches
~/.claude/skills/evaluate-rag
What's inside
- Skill name
evaluate-rag- Description
- Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, assessing generation faithfulness or relevance, generating synthetic QA pairs for retrieval testing, or optimizing chunking strategies.
- License
- unknown
- Instructions
- 170 lines in SKILL.md · view on GitHub
Files (1)
- SKILL.md
The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub
More from Avi977/ace-claude-toolkit
- 0.405score
egg-assistant
Avi977
Core personal assistant behaviors for Egg.
SkillDFreshness: DClaude Code +9 - 0.405score
egg-research
Avi977
Deep web research and fact-checking for Egg.
SkillDFreshness: DClaude Code +9 - 0.405score
egg-tool-builder
Avi977
Create new tools for the Egg AI agent.
SkillDFreshness: DClaude Code +9 - 0.405score
error-analysis
Avi977
Help the user systematically identify and categorize failure modes in an LLM pipeline by reading traces.
SkillDFreshness: DClaude Code +9 - 0.405score
eval-audit
Avi977
Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc.
SkillDFreshness: DClaude Code +9 - 0.405score
generate-synthetic-data
Avi977
Create diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation.
SkillDFreshness: DClaude Code +9
Signals
- Stars
- 0
- Forks
- 0
- Open issues
- 0
- Last commit (this folder)
- Mar 17, 2026 (7 months ago)
From GitHub (fetched Oct 24, 2026).
Details
- License
- License unknown
- Repository
- github.com/Avi977/ace-claude-toolkit
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
More from Avi977
- 0.405score
egg-assistant
Avi977
Core personal assistant behaviors for Egg.
SkillDFreshness: DClaude Code +9 - 0.405score
egg-research
Avi977
Deep web research and fact-checking for Egg.
SkillDFreshness: DClaude Code +9 - 0.405score
egg-tool-builder
Avi977
Create new tools for the Egg AI agent.
SkillDFreshness: DClaude Code +9 - 0.405score
error-analysis
Avi977
Help the user systematically identify and categorize failure modes in an LLM pipeline by reading traces.
SkillDFreshness: DClaude Code +9 - 0.405score
eval-audit
Avi977
Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc.
SkillDFreshness: DClaude Code +9 - 0.405score
generate-synthetic-data
Avi977
Create diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation.
SkillDFreshness: DClaude Code +9
Cite this page
evaluate-rag skill. Agent Mart. https://agentmart.dev/skills/avi977-evaluate-rag (last updated 2026-10-24)