Skip to content
Agentmart
Submit a tool
This entry duplicates agent-platform-eval-flywheel, which is the one we list in search.

agent-platform-eval-flywheel

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology.

Skill by aibangjuxin

IndexedLicense unknown★ 2
Write a review

Install

Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install skill/aibangjuxin-agent-platform-eval-flywheel

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when generating synthetic user scenarios, evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.

Use cases: devops, cloud, ml, writing

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions: not checked yet.

What's inside

Skill name
agent-platform-eval-flywheel
Description
Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when generating synthetic user scenarios, evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy.
License
unknown
Metadata
version: 1.0.3 · category: AiAndMachineLearning
Instructions
578 lines in SKILL.md · view on GitHub

Before installing

  • Ships executable scripts

Agent Skills spec issues

  • body: 578 lines (spec recommends under 500)

Files (13)

  • SKILL.md
  • dataset_schema.md · references/
  • deployment.md · references/
  • failure_patterns.md · references/
  • metric_registry.md · references/
  • sdk_patterns.md · references/
  • compare_results.py · scripts/
  • endpoint_evaluation.py · scripts/
  • inspect_results.py · scripts/
  • maas_evaluation.py · scripts/
  • parse_adk_traces.py · scripts/
  • render_html_report.py · scripts/
  • validate_dataset.py · scripts/

The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub

Signals

Stars
2
Forks
0
Open issues
213
Last commit (this folder)
Oct 15, 2026 (15 days ago)
Last release
Apr 12, 2024 (2 years ago)

From GitHub (fetched Oct 24, 2026).

Details

Version
1.0.3
License
License unknown
First seen
Oct 24, 2026
Last checked
Oct 24, 2026

Same skill elsewhere

Copies of this SKILL.md published by others; search shows only one of them.

More from aibangjuxin

Cite this page

agent-platform-eval-flywheel skill. Agent Mart. https://agentmart.dev/skills/aibangjuxin-agent-platform-eval-flywheel (last updated 2026-10-24)