Add Benchmark

by ory

Add Benchmark is an AI Engineering skill for Claude Code, published by ory in lumen.

254 stars31 forkson ory/lumenAdded 2026/09/02Repository updated 2026/08/11

View source on GitHub Download repo ZIP

agentic-codingclaudeclaude-aiclaude-codeclaude-plcodexcontextgeminigolanggpt-5mcpmcp-serverplugin

Install in seconds

Install Add Benchmark

Copy Add Benchmark into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/ory/lumen/tree/main/.claude/skills/add-benchmark ~/.claude/skills/add-benchmark

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/ory/lumen.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: .claude/skills/add-benchmark/SKILL.md in ory/lumen
Installs to: ~/.claude/skills/add-benchmark
Collection: One of 3 skills cataloged from this repository
Category: AI Engineering — 2631 skills

What Add Benchmark does

Add Benchmark creates a new SWE benchmark task from a real GitHub bug fix. It validates the issue or PR, generates the task and patch files, and reports verification results.

Add Benchmark is cataloged under AI Engineering on DirSkills. Add Benchmark comes from a repository tagged agentic-coding, claude, claude-ai, claude-code and claude-pl.

Documentation

README

Excerpt

Add SWE Benchmark

Add a new benchmark task to the bench-swe pipeline from a real GitHub bug-fix. The human provides the GitHub issue or PR URL; the agent handles extraction, validation, and file creation.

Arguments

url (required): GitHub issue or PR URL (e.g. https://github.com/gorilla/mux/issues/534 or https://github.com/gorilla/mux/pull/585)
language (required): One of: go, python, typescript, javascript, rust, ruby, java, c, cpp, php, csharp

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Add Benchmark

What else does ory publish alongside Add Benchmark?
Add Benchmark is one of 3 skills that DirSkills catalogs from ory/lumen, the repository it ships in. Its siblings there include Lumen Doctor and Lumen Reindex. Each one is a separate skill with its own page in this directory, installs the same way Add Benchmark does, and is maintained by ory in that same repository. The rest of the collection is listed on the ory/lumen page.
How does Add Benchmark compare to other AI Engineering skills?
Add Benchmark ranks #2294 by stars among the 2631 AI Engineering skills in this catalog. The most-starred ones next to it are Architecture Decision Records, AI-First Engineering and Agentic OS. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Add Benchmark against them. Open each page to compare what they document and how they install.