“LLM evaluation”

Evaluate final reports, serious chat answers, concept cards, or math explanations using deterministic checks and independent LLM-as-a-judge rubrics for…

On-demand LLM-as-judge evaluation of response quality against a structured rubric

Run model generation, pairwise Gemini scoring, and eval-db persistence.

Hướng dẫn chuyên sâu về phương pháp Usability Test, chuẩn bị công cụ kiểm thử, phân tích dữ liệu thực nghiệm khách quan và quy trình đề xuất cải tiến UI.

CLAUDE.md from HolmesGPT/holmesgpt: 913 lines covering Repository Overview, Development Commands, Architecture Overview, Testing Framework and more.

0-arg eval extension.

Build an automated evaluation pipeline that tests a Python LLM application end-to-end with pixie test — real code paths, real LLM calls, instrumented external…

Evaluation approaches and iterative development for learning products: pilot plans, SAM cycles, Kirkpatrick, and friction logging.

Extract evaluation-protocol elements from a source and mark unstated or ambiguous parameters.

Apply the ScholarEval framework to systematically evaluate scholarly work across quality dimensions (novelty, rigor, significance, and clarity).

Build and maintain an LLM-curated knowledge base from papers, articles, transcripts, notes and project findings.

Self-rate a completed non-trivial task on accuracy, completeness, clarity, actionability, and conciseness, with evidence per axis and a 1-5 scorecard.

Decompose an evaluation metric into rewarded signals, aggregation choices, polarity, ceiling effects, and Goodhart vulnerabilities.

Conduct expert heuristic evaluations using Nielsen's heuristics and domain-specific criteria.

Emit structured self-evaluation telemetry and report artifacts for the current agent session.

Build, validate, and package reusable evaluation datasets for agent and LLM systems from prompts, traces, tool-call logs, metadata, and expected outcomes.

Evaluate the value of staging, deferral, reversible commitment, and information-gathering options under uncertainty; return decision-relevant option value and…

Create or update the reusable evaluation contract that future Agents use to review product and UI design consistently.

Recalculate product unit economics and sensitivities from explicit quote, BOM, fee, and logistics inputs.

Systematic content evaluation framework progressing through Critique → Reinforcement → Risk Analysis → Growth.

Build a protocol-difference matrix and estimate which differences can materially change measured performance.

To systematically assess the performance, accuracy, and safety of LLM outputs using quantitative metrics and "LLM-as-a-Judge" patterns, ensuring production…

Evaluate and design data warehouse schemas — star, snowflake, data vault, OBT — with grain definition, SCD strategies, and normalization trade-offs

Deprecated alias for novel-craft-draft-review.