skill-tracker

Files (2)

• SKILL.md
• tracker.py

SKILL.md (first lines)

# Skill Tracker

## Overview

Track which skills are being used, how often, and whether they're being used correctly. Generate reports to identify:

- Most/least used skills
- Skills with high improper usage rates
- Unused skills that could be pruned
- Usage trends over time

**Synced Report Location:** `~/.pi/skill-tracker/REPORT.md` (auto-generated)

## Parameters

- **action** (required): One of:
  - `log` - Log a skill usage event
  - `report` - Generate usage report
  - `mark` - Mark a skill usage as proper/improper
  - `stats` - Quick statistics summary
  - `review` - Review recent usages for correctness
- **skill_name** (optional for report/stats, required for log/mark): Name of the skill
- **correctness** (optional for log, required for mark): `proper`, `improper`, or `unknown`
- **notes** (optional): Context or notes about the usage
- **days** (optional, default: 30): Number of days to include in report
- **output** (optional): Output format - `table`, `json`, or `markdown`

## Steps

### 1. Log Skill Usage

**When to use:** After any skill is triggered, log its usage.

**Python CLI:**

```bash
python3 skills/skill-tracker/tracker.py log --skill <name> --correctness <proper|improper|unknown> --notes "<context>" --context "<what user asked>"
```

**Examples:**

```bash
# Log proper usage
python3 skills/skill-tracker/tracker.py log --skill pdd --correctness proper --notes "Perfect fit for feature planning" --context "User wanted to design a new feature"

# Log with unknown correctness (will prompt for review later)
python3 skills/skill-tracker/tracker.py log --skill code-assist --correctness unknown --context "User asked for help with code"

# Log improper usage with explanation
python3 skills/skill-tracker/tracker.py log --skill pdd --correctness improper --notes "User just wanted a quick fix, not full design" --context "Quick bug fix"
```

**Auto-logging:** The system should automatically log when skills are triggered via `/skill run` or skill shortcuts.

### 2. Generate Usage Report

**Python CLI:**

```bash
python3 skills/skill-tracker/tracker.py report [--days 30] [--format table|json|markdown]
```

**Examples:**

```bash
# Default table report
python3 skills/skill-tracker/tracker.py report

# Markdown report for sharing
python3 skills/skill-tracker/tracker.py report --format markdown

# JSON for programmatic use
python3 skills/skill-tracker/tracker.py report --format json

# Last 7 days only
python3 skills/skill-tracker/tracker.py report --days 7
```

**Report includes:**

- Total skill invocations
- Most used skills (with counts)
- Skills with improper usage flagged
- Unused skills (available but never used)
- Proper usage rate by skill

**Synced Report:** To update the synced report file:

```bash
python3 skills/skill-tracker/tracker.py report --format markdown > ~/.pi/skill-tracker/REPORT.md
```

### 3. Mark Correctness

**When to use:** Retroactively mark whether a skill was used properly.

**Python CLI:**

```bash
python3 skills/skill-tracker/tracker.py mark --entry-id <id> --correctness <proper|improper> [--notes "<reason>"]
```

**Example:**

```bash
python3 skills/skill-tracker/tracker.py mark --entry-id 890b955f --correctness improper --notes "User seemed confused about what this skill does"
```

### 4. Quick Stats

**Python CLI:**

```bash
python3 skills/skill-tracker/tracker.py stats [--days 30]
```

**Shows:**

- Total skills available

From exoad/bibo-agent, Apache-2.0.

More from exoad/bibo-agent