🧪
QualityJavaScript

FrontierHarness Eval

by runta-dev

FrontierHarness Eval is a Quality skill for Claude Code, published by runta-dev in frontier-harness-eval.

162 stars9 forkson runta-dev/frontier-harness-evalAdded 2026/09/08+153% in starsRepository updated 2026/09/08
claude-codecodexdeepseek-harnessevalevalsevaluationevaluation-frameworkevaluation-metricsexo-harnessfrontier-harnessfrontierharnessharnessharness-benchmarkopencodepi-agent
Install in seconds
Install FrontierHarness Eval
Copy FrontierHarness Eval into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.
terminal
npx degit https://github.com/frontier-harness-eval/eval/tree/main/skills/frontierharness-eval ~/.claude/skills/frontierharness-eval

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/frontier-harness-eval/eval.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file
skills/frontierharness-eval/SKILL.md in runta-dev/frontier-harness-eval
Installs to
~/.claude/skills/frontierharness-eval
Collection
The only skill cataloged from this repository
Category
Quality1897 skills

What FrontierHarness Eval does

FrontierHarness Eval benchmarks a third-party coding-agent harness against FrontierHarness baselines using identical fresh restores, saved trajectories, and comparable cost accounting. Use it when evaluating, scoring, or comparing a harness such as FrontierHarness, DeepSWE, or Terminal-Bench setups.

FrontierHarness Eval is cataloged under Quality on DirSkills. FrontierHarness Eval comes from a repository tagged claude-code, codex, deepseek-harness, eval and evals.

Documentation

README

FrontierHarness Eval for a Third-Party Harness

Score a harness that is not in the published FrontierHarness v1.0 set, on the same tasks, runtime, and cost accounting, so the result can be placed next to the twelve baseline configurations in results/eval-data.json.

Prerequisites

Confirm all of these before touching a runtime:

runta --version                 # brew install runta-dev/tap/runta  (or npm i -g @runta/runta-cli)
runta checkpoint ls             # any API call proves the CLI is authenticated
jq --version && node --version  # jq for trial parsing, node >= 18 for the report scripts

This is the opening of the README. Read the full README on GitHub.

Frequently asked about FrontierHarness Eval

  • How does FrontierHarness Eval compare to other Quality skills?

    FrontierHarness Eval ranks #1799 by stars among the 1897 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of FrontierHarness Eval against them. Open each page to compare what they document and how they install.