Agent Evaluation

by rlaope

Agent Evaluation is a Quality skill for Claude Code, published by rlaope in oh-my-hermes.

1.1K stars103 forkson rlaope/oh-my-hermesAdded 2026/08/21+4% in starsRepository updated 2026/08/21

View source on GitHub Download repo ZIP

agentaiai-agentai-toolsclaude-codecodexhermes-agenthermes-skillskills

Install in seconds

Install Agent Evaluation

Copy Agent Evaluation into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/rlaope/oh-my-hermes/tree/main/skills/omh-agent-evaluation ~/.claude/skills/omh-agent-evaluation

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/rlaope/oh-my-hermes.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: skills/omh-agent-evaluation/SKILL.md in rlaope/oh-my-hermes
Installs to: ~/.claude/skills/omh-agent-evaluation
Collection: One of 25 skills cataloged from this repository
Category: Quality — 1354 skills

What Agent Evaluation does

Agent Evaluation compares Codex, Claude Code, Hermes, or other executors on reproducible tasks using quality, cost, time, tool, and evidence metrics. Use it to choose a runtime or benchmark agent output fairly.

Agent Evaluation is cataloged under Quality on DirSkills. Agent Evaluation comes from a repository tagged agent, ai, ai-agent, ai-tools and claude-code.

Documentation

README

Excerpt

The user needs current runtime readiness only; use executor-runtime-readiness.
The user already selected an executor and wants implementation; use the coding handoff or delivery workflow.
The user asks for workflow learning from a single failed route; use workflow-learning.
The ask is to find and fix runtime, memory, cost, or rendering hotspots rather than score executor or model output quality; use ultraperf.

Examples

Good example:

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Agent Evaluation

What else does rlaope publish alongside Agent Evaluation?
Agent Evaluation is one of 25 skills that DirSkills catalogs from rlaope/oh-my-hermes, the repository it ships in. Its siblings there include Accessibility Audit, Adding A Skill and Agent Board. Each one is a separate skill with its own page in this directory, installs the same way Agent Evaluation does, and is maintained by rlaope in that same repository. The rest of the collection is listed on the rlaope/oh-my-hermes page.
How does Agent Evaluation compare to other Quality skills?
Agent Evaluation ranks #812 by stars among the 1354 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Agent Evaluation against them. Open each page to compare what they document and how they install.