arize-evaluator
Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks…
Skill by arize
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/asleekgeek-arize-evaluator
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: ml, agent-building
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.
- Tools
- No tools found
- Secrets
- None asked for
- Install scripts
- None found
Network hosts it talks to 1
codeload.github.com· found in install command
Files it touches
~/.claude/skills/arize-evaluator
What's inside
- Skill name
arize-evaluator- Description
- Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
- License
- unknown
- Compatibility
- Requires the ax CLI and a configured Arize profile with an AI integration.
- Metadata
- author: arize · version: 1.0
- Instructions
- 666 lines in SKILL.md · view on GitHub
Agent Skills spec issues
- body: 666 lines (spec recommends under 500)
Files (3)
- SKILL.md
- ax-profiles.md · references/
- ax-setup.md · references/
The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub
More from asleekgeek/claude-multiagent-catalogue
- 0.507score
azure-pricing
anthonychu
Fetches real-time Azure retail pricing using the Azure Retail Prices API (prices.azure.com) and estimates Copilot Studio agent credit consumption.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
copilot-to-claude-multiagent
asleekgeek
Convert any GitHub Copilot marketplace artefact (standalone agent, instruction fragment, plugin bundle, skill, hook, agentic workflow, cookbook recipe) into…
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-ai-provider-integration
arize
Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-annotation
arize
Creates and manages annotation configs (categorical, continuous, freeform label schemas) and annotation queues (human review workflows) on Arize.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-dataset
arize
Creates, manages, and queries Arize datasets and examples.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-experiment
arize
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-instrumentation
arize
Adds Arize AX tracing to an LLM application for the first time.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-link
arize
Generates deep links to the Arize UI for traces, spans, sessions, datasets, labeling queues, evaluators, and annotation configs.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-prompt-optimization
arize
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-trace
arize
Downloads, exports, and inspects existing Arize traces and spans to understand what an LLM app is doing or debug runtime issues.
SkillCFreshness: C★ 2Claude Code +9 - 0.499score
automate-this
asleekgeek
Analyze a screen recording of a manual process and produce targeted, working automation scripts.
SkillCFreshness: C★ 2Claude Code +9 - 0.499score
suggest-awesome-github-copilot-agents
asleekgeek
Suggest relevant GitHub Copilot Custom Agents files from the awesome-copilot repository based on current repository context and chat history, avoiding…
SkillCFreshness: C★ 2Claude Code +9
Signals
- Stars
- 2
- Forks
- 2
- Open issues
- 0
- Last commit (this folder)
- May 19, 2026 (5 months ago)
From GitHub (fetched Oct 24, 2026).
Details
- Version
- 1.0
- License
- License unknown
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
More from arize
- 0.507score
arize-ai-provider-integration
arize
Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-annotation
arize
Creates and manages annotation configs (categorical, continuous, freeform label schemas) and annotation queues (human review workflows) on Arize.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-dataset
arize
Creates, manages, and queries Arize datasets and examples.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-experiment
arize
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-instrumentation
arize
Adds Arize AX tracing to an LLM application for the first time.
SkillCFreshness: C★ 2Claude Code +9 - 0.507score
arize-link
arize
Generates deep links to the Arize UI for traces, spans, sessions, datasets, labeling queues, evaluators, and annotation configs.
SkillCFreshness: C★ 2Claude Code +9
Cite this page
arize-evaluator skill. Agent Mart. https://agentmart.dev/skills/asleekgeek-arize-evaluator (last updated 2026-10-24)