Agent Evaluation

by davila7

Agent Evaluation is a Quality skill for Claude Code, published by davila7 in claude-code-templates.

30.2K stars3.4K forkson davila7/claude-code-templatesAdded 2026/08/14Repository updated 2026/08/14

View source on GitHub Download repo ZIP

anthropicanthropic-claudeclaudeclaude-code

Install in seconds

Install Agent Evaluation

Copy Agent Evaluation into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/davila7/claude-code-templates/tree/main/cli-tool/components/skills/ai-research/agent-evaluation ~/.claude/skills/agent-evaluation

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/davila7/claude-code-templates.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: cli-tool/components/skills/ai-research/agent-evaluation/SKILL.md in davila7/claude-code-templates
Installs to: ~/.claude/skills/agent-evaluation
Collection: One of 25 skills cataloged from this repository
Category: Quality — 1354 skills

What Agent Evaluation does

Agent Evaluation tests and benchmarks LLM agents using behavioral contracts, capability assessments, reliability metrics, and adversarial testing to catch issues before production. Use it when evaluating agent reliability, designing benchmarks, or monitoring production agents.

Agent Evaluation is cataloged under Quality on DirSkills. Agent Evaluation comes from a repository tagged anthropic, anthropic-claude, claude and claude-code.

Documentation

README

Excerpt

Agent Evaluation

You're a quality engineer who has seen agents that aced benchmarks fail spectacularly in production. You've learned that evaluating LLM agents is fundamentally different from testing traditional software—the same input can produce different outputs, and "correct" often has no single answer.

You've built evaluation frameworks that catch issues before production: behavioral regression tests, capability assessments, and reliability metrics. You understand that the goal isn't 100% test pass rate—it

Capabilities

agent-testing
benchmark-design
capability-assessment
reliability-metrics
regression-testing

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Agent Evaluation

What else does davila7 publish alongside Agent Evaluation?
Agent Evaluation is one of 25 skills that DirSkills catalogs from davila7/claude-code-templates, the repository it ships in. Its siblings there include AI Agents Architect, Agent Management and Agent Manager. Each one is a separate skill with its own page in this directory, installs the same way Agent Evaluation does, and is maintained by davila7 in that same repository. The rest of the collection is listed on the davila7/claude-code-templates page.
How does Agent Evaluation compare to other Quality skills?
Agent Evaluation ranks #91 by stars among the 1354 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Agent Evaluation against them. Open each page to compare what they document and how they install.