๐Ÿงช
AI EngineeringPython

Experiment Plan

by wanshuiyin

Experiment Plan is an AI Engineering skill for Claude Code, published by wanshuiyin in Auto-claude-code-research-in-sleep.

14.7K stars1.3K forkson wanshuiyin/Auto-claude-code-research-in-sleepAdded 2026/08/14Repository updated 2026/08/11
ai-researchai-toolsarisautonomous-agentclaudeclaude-codeclaude-code-skillscodexdeep-learninggptidea-generationllmmachine-learningmcpmcp-serverml-researchopenaipaper-reviewpaper-writingresearch-automation
Install in seconds
Install Experiment Plan
Copy Experiment Plan into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.
terminal
npx degit https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/experiment-plan ~/.claude/skills/experiment-plan

Requires Node.js. Downloads this skill only โ€” not the rest of the repository โ€” into your Claude Code skills folder.

Without Node.js

git clone https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git

Clones the whole repository, then copy the skillโ€™s own directory into your skills folder yourself.

In this catalog

Source file
skills/experiment-plan/SKILL.md in wanshuiyin/Auto-claude-code-research-in-sleep
Installs to
~/.claude/skills/experiment-plan
Collection
One of 25 skills cataloged from this repository
Category
AI Engineering โ€” 3670 skills

What Experiment Plan does

Experiment Plan turns a refined research proposal into a detailed, claim-driven experiment roadmap. It specifies experiment blocks, baselines, metrics, and run order to defend a paper's core claims.

Experiment Plan is cataloged under AI Engineering on DirSkills. Experiment Plan comes from a repository tagged ai-research, ai-tools, aris, autonomous-agent and claude.

Documentation

README

Experiment Plan: Claim-Driven, Paper-Oriented Validation

Refine and concretize: $ARGUMENTS

Overview

Use this skill after the method is stable enough that the next question becomes: what exact experiments should we run, in what order, to defend the paper? If the user wants the full chain in one request, prefer /research-refine-pipeline.

The goal is not to generate a giant benchmark wishlist. The goal is to turn a proposal into a claim -> evidence -> run order roadmap that supports four things:

  1. the method actually solves the anchored problem
  2. the dominant contribution is real and focused
  3. the method is elegant enough that extra complexity is unnecessary
  4. any frontier-model-era component is genuinely useful, not decorative

Constants

This is the opening of the README. Read the full README on GitHub.

Commands Experiment Plan provides

Slash commands named in this skillโ€™s SKILL.md, listed in the order they first appear.

  • /research-refine-pipeline
  • /research-refine
  • /experiment-plan
  • /run-experiment
  • /auto-review-loop

Frequently asked about Experiment Plan

  • What else does wanshuiyin publish alongside Experiment Plan?

    Experiment Plan is one of 25 skills that DirSkills catalogs from wanshuiyin/Auto-claude-code-research-in-sleep, the repository it ships in. Its siblings there include Ablation Planner, AlphaXiv and Analyze Results. Each one is a separate skill with its own page in this directory, installs the same way Experiment Plan does, and is maintained by wanshuiyin in that same repository. The rest of the collection is listed on the wanshuiyin/Auto-claude-code-research-in-sleep page.

  • How does Experiment Plan compare to other AI Engineering skills?

    Experiment Plan ranks #310 by stars among the 3670 AI Engineering skills in this catalog. The most-starred ones next to it are Architecture Decision Records, AI-First Engineering and Agentic OS. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Experiment Plan against them. Open each page to compare what they document and how they install.

More from wanshuiyin/Auto-claude-code-research-in-sleep

Experiment Plan is one of 25 skills cataloged on DirSkills from wanshuiyin/Auto-claude-code-research-in-sleep.

See all 25 skills โ†’
๐Ÿ”ฌ
2026/08/14

Ablation Planner

Ablation Planner designs ablation studies for machine learning research papers, isolating component contributions and prioritizing experiments when main results pass.
AI Engineering
14.7K1.3K
๐Ÿ“„
2026/08/14

AlphaXiv

AlphaXiv returns LLM-optimized summaries for a single paper from AlphaXiv, with tiered source fallback. Use when asked to explain or summarize a paper, or given an arXiv/AlphaXiv URL or ID.
Automation
14.7K1.3K
๐Ÿ“Š
2026/08/14

Analyze Results

Analyze Results analyzes ML experiment results, computes statistics, and generates comparison tables and insights. Use when the user says "analyze results", "compare", or needs to interpret experimental data.
Data
14.7K1.3K
๐Ÿ“„
2026/08/14

ArXiv Paper Search

ArXiv Paper Search searches arXiv for papers, fetches details by ID, downloads PDFs, and summarizes them; use it when the user asks to search arxiv, get a paper, download a paper, or save PDFs to a local library.
Automation
14.7K1.3K
๐Ÿ“
2026/08/14

Auto Paper Improvement Loop

Auto Paper Improvement Loop iteratively improves a generated paper via external LLM review, fix implementation, and recompilation for two rounds. Use it after paper generation to catch structural and presentation issues.
Writing
14.7K1.3K
๐Ÿ”
2026/08/14

Auto Review Loop

Auto Review Loop autonomously iterates review, implements fixes, and re-reviews until an independent reviewer gives a policy-approved positive assessment or MAX_ROUNDS is reached.
AI Engineering
14.7K1.3K