Benchmark Design

by Prism-Shadow

Benchmark Design is an AI Engineering skill for Claude Code, published by Prism-Shadow in penguin-harness.

1.5K stars150 forkson Prism-Shadow/penguin-harnessAdded 2026/08/19+21% in starsRepository updated 2026/08/19

View source on GitHub Download repo ZIP

agentagentic-aiaibuild-toolclaude-codedeepseekdeepseek-harnessdesktopharnessllmrsiself-evolving

Install in seconds

Install Benchmark Design

Copy Benchmark Design into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/Prism-Shadow/penguin-harness/tree/main/packages/skills/skills/benchmark-design ~/.claude/skills/benchmark-design

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/Prism-Shadow/penguin-harness.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: packages/skills/skills/benchmark-design/SKILL.md in Prism-Shadow/penguin-harness
Installs to: ~/.claude/skills/benchmark-design
Collection: One of 21 skills cataloged from this repository
Category: AI Engineering — 2451 skills

What Benchmark Design does

Benchmark Design builds and calibrates a multi-Case capability benchmark for one Test Agent and establishes a traceable Formal Baseline. Use it when you need to design, pilot, and freeze a benchmark without changing the test agent.

Benchmark Design is cataloged under AI Engineering on DirSkills. Benchmark Design comes from a repository tagged agent, agentic-ai, ai, build-tool and claude-code.

Documentation

README

Excerpt

Benchmark Design

Build a multi-Case Benchmark for one Test Agent, calibrate its difficulty with one Run per Case, and record the selected frozen Pilot as the Formal Baseline.

This Skill changes the Benchmark, never the Test Agent. It does not run or score the Test Agent. Delegate every evaluation with run_subagent, and tell each worker to use agent-evaluation. Stop after the Baseline; do not begin optimization.

Before you start

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Benchmark Design

What else does Prism-Shadow publish alongside Benchmark Design?
Benchmark Design is one of 21 skills that DirSkills catalogs from Prism-Shadow/penguin-harness, the repository it ships in. Its siblings there include Agent Creation, Agent Evaluation and Agent Optimization. Each one is a separate skill with its own page in this directory, installs the same way Benchmark Design does, and is maintained by Prism-Shadow in that same repository. The rest of the collection is listed on the Prism-Shadow/penguin-harness page.
How does Benchmark Design compare to other AI Engineering skills?
Benchmark Design ranks #990 by stars among the 2451 AI Engineering skills in this catalog. The most-starred ones next to it are Architecture Decision Records, AI-First Engineering and Agentic OS. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Benchmark Design against them. Open each page to compare what they document and how they install.