Scoreable File First

by tangxiangru

Scoreable File First is an Automation skill for Claude Code, published by tangxiangru in AutoR.

804 stars25 forkson tangxiangru/AutoRAdded 2026/08/22Repository updated 2026/08/22

View source on GitHub Download repo ZIP

agentaiai-scientistauto-researchclaudeclaude-codecliharnessllmopenaipaperscience

Install in seconds

Install Scoreable File First

Copy Scoreable File First into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/tangxiangru/AutoR/tree/main/src/skills/a-scoreable-file-in-the-first-hour ~/.claude/skills/a-scoreable-file-in-the-first-hour

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/tangxiangru/AutoR.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: src/skills/a-scoreable-file-in-the-first-hour/SKILL.md in tangxiangru/AutoR
Installs to: ~/.claude/skills/a-scoreable-file-in-the-first-hour
Collection: One of 25 skills cataloged from this repository
Category: Automation — 1523 skills

What Scoreable File First does

Scoreable File First tells you to create a valid predictions file in the first hour and keep improving it in place. Use it when a run can be scored only if a submission file exists and stays valid.

Scoreable File First is cataloged under Automation on DirSkills. Scoreable File First comes from a repository tagged agent, ai, ai-scientist, auto-research and claude.

Documentation

README

Excerpt

Write a scoreable file before you write anything else

A predictions file that does not exist scores nothing. Not a low score — no score, and on a benchmark that reports valid submission rate as a headline metric beside the score, a missing file costs you on two axes at once.

So the first version is not a milestone to work toward. It is a thing to get out of the way in the first hour, from whatever you can compute immediately, and then improve in place for the rest of the run.

Why this is not the obvious advice

The instinct is that a trivial submission is embarrassing and that a real one is close, so it is better to wait. Two measurements say otherwise.

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Scoreable File First

What else does tangxiangru publish alongside Scoreable File First?
Scoreable File First is one of 25 skills that DirSkills catalogs from tangxiangru/AutoR, the repository it ships in. Its siblings there include A Deliverable Is Not an Instruction, A Value You Did Not Measure Still Has A Source and Answer The Why, Not Only The What. Each one is a separate skill with its own page in this directory, installs the same way Scoreable File First does, and is maintained by tangxiangru in that same repository. The rest of the collection is listed on the tangxiangru/AutoR page.
How does Scoreable File First compare to other Automation skills?
Scoreable File First ranks #988 by stars among the 1523 Automation skills in this catalog. The most-starred ones next to it are Autonomous Loops, Autonomous Agent Harness and Automation Audit Ops. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Scoreable File First against them. Open each page to compare what they document and how they install.