“LLM evaluation”

Use when a request needs a baseline for one configuration to run, read, or iterate; not for a controlled comparison across multiple configurations (use…

Evaluate CampaignForge concepts, media, and channel drafts for brand fit, clarity, factual support, and platform readiness before final review.

Evaluates scientific figures for publication quality using VLM-as-a-judge.

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents…

Use when asked how the labor-code assistant performs, to score it, or to review its golden set.

INVOKE THIS SKILL when building evaluation pipelines for LangSmith.

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents…

Autonomous AI agent benchmark evaluation register: task completion rates, planning accuracy, tool invocation precision, and cost benchmarks.

Planejar avaliação de computação com baselines e validade.

End-to-end Torch LLM PTQ recipe for AMD Quark — for PyTorch / HuggingFace transformers models (safetensors input): quantize, then validate, then evaluate…

Evaluate DDD principle conformance across 3 layers and 12 criteria.

Qualitative evaluation of Modularity Maturity Index across 4 axes: cohesion, coupling, independence, reusability.

Evaluate final reports, serious chat answers, concept cards, or math explanations using deterministic checks and independent LLM-as-a-judge rubrics for…

On-demand LLM-as-judge evaluation of response quality against a structured rubric

Run model generation, pairwise Gemini scoring, and eval-db persistence.

Hướng dẫn chuyên sâu về phương pháp Usability Test, chuẩn bị công cụ kiểm thử, phân tích dữ liệu thực nghiệm khách quan và quy trình đề xuất cải tiến UI.

0-arg eval extension.

Build an automated evaluation pipeline that tests a Python LLM application end-to-end with pixie test — real code paths, real LLM calls, instrumented external…

Evaluation approaches and iterative development for learning products: pilot plans, SAM cycles, Kirkpatrick, and friction logging.

Extract evaluation-protocol elements from a source and mark unstated or ambiguous parameters.

Apply the ScholarEval framework to systematically evaluate scholarly work across quality dimensions (novelty, rigor, significance, and clarity).

Build and maintain an LLM-curated knowledge base from papers, articles, transcripts, notes and project findings.

Self-rate a completed non-trivial task on accuracy, completeness, clarity, actionability, and conciseness, with evidence per axis and a 1-5 scorecard.

Decompose an evaluation metric into rewarded signals, aggregation choices, polarity, ceiling effects, and Goodhart vulnerabilities.