mine-tasks

Files (1)

• SKILL.md

SKILL.md (first lines)

# Mine Tasks

Point at a codebase — on any code host or locally — and get a baseline-vs-MCP comparison for AI coding agents. Mines real merged PRs/MRs to create eval tasks where agents must reproduce known fixes/features, then measures whether MCP tools (code search, semantic indexing) help agents find the right code faster.

Works with GitHub, GitLab, Bitbucket, Azure DevOps, self-hosted Gitea/Forgejo, or plain local git repos.

**Two workflows:**

- **Quick eval** (default): Mine 5-10 SDLC tasks from merged PRs/MRs, auto-generate ground truth, produce runnable Dockerfiles, print `docker run` commands. ~10 minutes to a working eval.
- **Full mining**: Deep analysis for contributing tasks to CodeScaleBench. Includes org-scale tasks, scoring, reviewer extraction, and `/scaffold-task` integration.

---

## Host Adapter Reference

All host-specific operations go through a detected adapter. The skill auto-detects the host from the URL and uses the appropriate CLI/API. When no API is available, it falls back to git-only mode.

### Host Detection

| URL Pattern | Host | CLI | Adapter |
|-------------|------|-----|---------|
| `github.com/*` | GitHub | `gh` | `github` |
| `gitlab.com/*` or self-hosted with `/api/v4/` | GitLab | `glab` | `gitlab` |
| `bitbucket.org/*` | Bitbucket | `curl` (REST v2) | `bitbucket` |
| `dev.azure.com/*` or `*.visualstudio.com/*` | Azure DevOps | `az repos` | `azure` |
| `*.gitea.*` or `*.forgejo.*` or user-specified | Gitea/Forgejo | `curl` (REST) | `gitea` |
| Local path (no remote) | — | — | `git_only` |
| Any other remote | — | — | `git_only` |

### Merge Request Operations

The skill needs these operations from each host. "MR" is used generically below (= PR on GitHub/Bitbucket, MR on GitLab, PR on Azure DevOps).

#### List merged MRs

```bash
# GitHub
gh pr list --repo {REPO} --state merged --limit {LIMIT} \
  --json number,title,body,labels,files,additions,deletions,closedAt,mergedAt

# GitLab
glab mr list --repo {REPO} --state merged --per-page {LIMIT} \
  --output json

# Bitbucket
curl -s -u "${BB_USER}:${BB_APP_PASSWORD}" \
  "https://api.bitbucket.org/2.0/repositories/{REPO}/pullrequests?state=MERGED&pagelen={LIMIT}"

# Azure DevOps
az repos pr list --organization {ORG_URL} --project {PROJECT} \
  --repository {REPO_NAME} --status completed --top {LIMIT} --output json

# Gitea / Forgejo
curl -s -H "Authorization: token ${GITEA_TOKEN}" \
  "{GITEA_URL}/api/v1/repos/{OWNER}/{REPO}/pulls?state=closed&sort=updated&limit={LIMIT}"

# git-only fallback (no API)
git log --merges --oneline --since="6 months ago" -n {LIMIT}
# Or for repos that use squash merges:
git log --oneline --since="6 months ago" --grep="fix\|feat\|bug\|refactor" -n {LIMIT}
```

#### Get MR diff

```bash
# GitHub
gh pr diff {NUMBER} --repo {REPO}

# GitLab
glab mr diff {NUMBER} --repo {REPO}

# Bitbucket
curl -s -u "${BB_USER}:${BB_APP_PASSWORD}" \
  "https://api.bitbucket.org/2.0/repositories/{REPO}/pullrequests/{NUMBER}/diff"

# Azure DevOps
az repos pr diff --id {NUMBER} --organization {ORG_URL} --output json
# Or: query the commits and diff them
az repos pr list --id {NUMBER} --query "[].{source: sourceRefName, target: targetRefName}" --output json

# Gitea / Forgejo
curl -s -H "Authorization: token ${GITEA_TOKEN}" \
  "{GITEA_URL}/api/v1/repos/{OWNER}/{REPO}/pulls/{NUMBER}.diff"

# git-only fallback
git diff {BASE_COMMIT}..{MERGE_COMMIT}
```

#### Get MR metadata (base commit, merge commit, author, linked issue)

```bash
# GitHub
gh pr view {NUMBER} --repo {REPO} --json mergeCommit,baseRefOid,author,title,body,labels

# GitLab
glab mr view {NUMBER} --repo {REPO} --output json
# Linked issues: parsed from MR description ("Closes #123") or via API
glab api "projects/{PROJECT_ID}/merge_requests/{NUMBER}/closes_issues"

# Bitbucket
curl -s -u "${BB_USER}:${BB_APP_PASSWORD}" \
  "https://api.bitbucket.org/2.0/repositories/{REPO}/pullrequests/{NUMBER}"

# Azure DevOps
az repos pr show --id {NUMBER} --organization {ORG_URL} --output json
# Linked work items:
az repos pr work-item list --id {NUMBER} --organization {ORG_URL} --output json

# Gitea / Forgejo
curl -s -H "Authorization: token ${GITEA_TOKEN}" \
  "{GITEA_URL}/api/v1/repos/{OWNER}/{REPO}/pulls/{NUMBER}"

# git-only fallback
# Parse from merge commit message: "Merge pull request #N" or "Fixes #N"
git log --format="%H %s" --merges -n 50 | grep -i "fix\|feat\|bug\|refactor"
# Base commit = first parent of merge commit
git rev-parse {MERGE_COMMIT}^1
```

From sourcegraph/CodeScaleBench, Apache-2.0.

More from sourcegraph/CodeScaleBench