“LLM evaluation”

Post-implementation review — summarizes what was built, then quizzes you on design decisions and tradeoffs.

Run a strict research benchmark for a model that will

MCP server providing access to the Scorecard API to evaluate and optimize LLM systems.

Use after completing any non-trivial task.

Plan or perform a layered accessibility evaluation across inspectable source, runtime behavior, assistive technologies, cognitive accessibility, and…

Run a skill's fixed scenarios on each model from throwaway homes, once or several times, and judge each record by script: a review's, or whether a request…

Systematic critical evaluation framework for analyzing arguments, detecting cognitive biases, and improving decision quality.

Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features.

Evaluates a named skill by running its artifact checks and optionally invoking the skill against fixture inputs.

Use before fixing, batching, or assigning GitHub issues or proposed fixes when the value is uncertain, the report came from AI/code analysis, the fix is…

Open-source tool to trace, evaluate and improve AI agents, run locally or self-hosted

Create diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation.

Patterns for calling LLM APIs, streaming, structured output, and cost controls per stack.

Valuation framework for a stock.

Establishes continuous evaluation loops with scenario replay, regression suites, and risk-focused acceptance gates.

Enterprise service for objective evaluation of generative AI models using adaptive and static rubrics

Adversarial evaluation: compare dev product against reference baseline using Playwright MCP

Evaluates a preliminary research idea against a five-dimension framework (Higher, Faster, Stronger, Cheaper, Broader) plus idea-lifecycle and…

Expert-level LLM Research Scientist with deep knowledge of transformer architectures, RLHF, DPO, Constitutional AI, alignment research, evaluation benchmarks…

Measures technological limitation counts in independent patent claims

Evaluate a Zira vision model — see how accurately it detects each class (precision, recall, the images it gets wrong, drawn on the images) by running it on a…

변경에 대해 QUALITY_SCORE 루브릭을 적용하고 증거를 수집할 때 사용한다.

Checks a Content Security Policy for weaknesses that allow script injection.

Master context engineering for AI agent systems.