🧪

QualityJavaScript

FrontierHarness Eval

by frontier-harness-eval

FrontierHarness Eval is a Quality skill for Claude Code, published by frontier-harness-eval in eval.

162 stars9 forkson frontier-harness-eval/evalAdded 2026/09/08+149% in starsRepository updated 2026/09/08

View source on GitHub Download repo ZIP

claude-codecodexdeepseek-harnessevalevalsevaluationevaluation-frameworkevaluation-metricsexo-harnessfrontier-harnessfrontierharnessharnessharness-benchmarkopencodepi-agent

Install in seconds

Install FrontierHarness Eval

Copy FrontierHarness Eval into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/frontier-harness-eval/eval/tree/main/skills/frontierharness-eval ~/.claude/skills/frontierharness-eval

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/frontier-harness-eval/eval.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: skills/frontierharness-eval/SKILL.md in frontier-harness-eval/eval
Installs to: ~/.claude/skills/frontierharness-eval
Collection: The only skill cataloged from this repository
Category: Quality — 1897 skills

What FrontierHarness Eval does

FrontierHarness Eval benchmarks a third-party coding-agent harness against FrontierHarness baselines using identical runs, saved trajectories, and a comparison report. Use it when evaluating a harness, comparing results, or checking FrontierHarness, DeepSWE, or Terminal-Bench setups.

FrontierHarness Eval is cataloged under Quality on DirSkills. FrontierHarness Eval comes from a repository tagged claude-code, codex, deepseek-harness, eval and evals.

Documentation

README

Excerpt

FrontierHarness Eval for a Third-Party Harness

Score a harness that is not in the published FrontierHarness v1.0 set, on the same tasks, runtime, and cost accounting, so the result can be placed next to the twelve baseline configurations in results/eval-data.json.

Prerequisites

Confirm all of these before touching a runtime:

runta --version                 # brew install runta-dev/tap/runta  (or npm i -g @runta/runta-cli)
runta checkpoint ls             # any API call proves the CLI is authenticated
jq --version && node --version  # jq for trial parsing, node >= 18 for the report scripts

This is the opening of the README. Read the full README on GitHub.

Frequently asked about FrontierHarness Eval

How does FrontierHarness Eval compare to other Quality skills?
FrontierHarness Eval ranks #1800 by stars among the 1897 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of FrontierHarness Eval against them. Open each page to compare what they document and how they install.

More Quality skills

FrontierHarness Eval is one of 1897 Quality skills cataloged on DirSkills, ranked #1800 by stars among them.

Browse all Quality skills →

Benchmark

Benchmark measures performance baselines, detects regressions before and after PRs, and compares stack alternatives for pages, APIs, and builds.

Benchmark Optimization Loop

Benchmark Optimization Loop turns vague performance goals into a bounded, measured optimization process. Use it when asked to make something faster, benchmark latency/throughput/cost, or choose the best implementation by repeated measured tests.

API Design Patterns

API Design Patterns provides conventions and best practices for designing consistent REST APIs. Use it when creating endpoints, reviewing contracts, handling pagination, error responses, status codes, filtering, or versioning.