Advanced Evaluation

Advanced Evaluation is an AI Engineering skill for Claude Code, published by guanyang in open-agent-hub.

952 stars164 forkson guanyang/open-agent-hubAdded 2026/08/21Repository updated 2026/08/21

agentsai-agentsai-skillsanthropic-skillsclaude-codecli-toolcontext-engineeringfull-stackplanningskillssuperpowersui-ux-designworkflows

Install in seconds

Install Advanced Evaluation

Copy Advanced Evaluation into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/guanyang/open-agent-hub/tree/main/skills/advanced-evaluation ~/.claude/skills/advanced-evaluation

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/guanyang/open-agent-hub.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: skills/advanced-evaluation/SKILL.md in guanyang/open-agent-hub
Installs to: ~/.claude/skills/advanced-evaluation
Collection: One of 25 skills cataloged from this repository
Category: AI Engineering — 2451 skills

What Advanced Evaluation does

Advanced Evaluation covers LLM-as-judge methods for scoring, pairwise comparison, rubric calibration, and bias mitigation. Use it when building automated evaluation workflows for model outputs or comparing responses.

Advanced Evaluation is cataloged under AI Engineering on DirSkills. Advanced Evaluation comes from a repository tagged agents, ai-agents, ai-skills, anthropic-skills and claude-code.

Documentation

README

Excerpt

Advanced Evaluation

This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.

Key insight: LLM-as-a-Judge is not a single technique but a family of approaches, each suited to different evaluation contexts. Choosing the right approach and mitigating known biases is the core competency this skill develops.

When to Activate

Activate this skill when:

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Advanced Evaluation

What else does guanyang publish alongside Advanced Evaluation?
Advanced Evaluation is one of 25 skills that DirSkills catalogs from guanyang/open-agent-hub, the repository it ships in. Its siblings there include Algorithmic Art, Article Illustrator and Baoyu Image Cards. Each one is a separate skill with its own page in this directory, installs the same way Advanced Evaluation does, and is maintained by guanyang in that same repository. The rest of the collection is listed on the guanyang/open-agent-hub page.
How does Advanced Evaluation compare to other AI Engineering skills?
Advanced Evaluation ranks #1428 by stars among the 2451 AI Engineering skills in this catalog. The most-starred ones next to it are Architecture Decision Records, AI-First Engineering and Agentic OS. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Advanced Evaluation against them. Open each page to compare what they document and how they install.