evaluating-machine-learning-models

Files (8)

• SKILL.md
• README.md · assets/
• visualization_script.py · assets/
• README.md · references/
• README.md · scripts/
• data_loader.py · scripts/
• evaluate_model.py · scripts/
• metrics_calculator.py · scripts/

SKILL.md (first lines)

# Model Evaluation Suite

Use this skill when the model exists and the question is whether it is good enough.

## Overview

This skill focuses on choosing and interpreting the right evaluation metrics for the problem, then comparing candidate models or thresholds.

## When to Use This Skill

- Comparing candidate models with consistent metrics
- Reviewing precision/recall/F1/AUC, regression error, calibration, or ranking quality
- Stress-testing validation strategy before deployment or publication

## Not For / Boundaries

- Building the training pipeline itself: use `scikit-learn` for classical modeling or `ml-pipeline-workflow` for end-to-end workflow ownership
- Engineering features: use `preprocessing-data-with-automated-pipelines`
- Checking train/test contamination: use `ml-data-leakage-guard`

## Typical Outputs

- Metric suite recommendations
- Model comparison tables
- Notes on threshold tradeoffs, calibration, and validation weaknesses

## Related Skills

- `scikit-learn` for class-level error breakdowns and confusion matrices
- `scientific-reporting` when the evaluation must become a deliverable

From foryourhealth111-pixel/Vibe-Skills, MIT.

More from foryourhealth111-pixel/Vibe-Skills