---
name: Experiment Analysis
slug: experiment-analysis
category: Data
description: Experiment Analysis analyzes ML experiment outputs, computes summary statistics, and builds comparison tables. Use it to compare runs, check reproducibility, and interpret results from JSON or CSV files.
github: "https://github.com/OpenLAIR/dr-claw/tree/main/skills/aris-analyze-results"
language: JavaScript
stars: 1047
forks: 116
install: "npx degit https://github.com/OpenLAIR/dr-claw/tree/main/skills/aris-analyze-results ~/.claude/skills/aris-analyze-results"
installs_to: ~/.claude/skills/aris-analyze-results
source_path: skills/aris-analyze-results/SKILL.md
collection_size: 25
category_size: 668
collection_url: "https://dirskills.com/collections/OpenLAIR/dr-claw"
added: 2026-08-21T05:13:55.415Z
last_synced: 2026-08-21T05:13:55.415Z
canonical_url: "https://dirskills.com/skills/experiment-analysis"
---

# Experiment Analysis

Experiment Analysis analyzes ML experiment outputs, computes summary statistics, and builds comparison tables. Use it to compare runs, check reproducibility, and interpret results from JSON or CSV files.

**Install:**

```bash
npx degit https://github.com/OpenLAIR/dr-claw/tree/main/skills/aris-analyze-results ~/.claude/skills/aris-analyze-results
```

## README

# Analyze Experiment Results

Analyze: $ARGUMENTS

## Workflow

### Step 1: Locate Results
Find all relevant JSON/CSV result files:
- Check `figures/`, `results/`, or project-specific output directories
- Parse JSON results into structured data

### Step 2: Build Comparison Table
Organize results by:
- **Independent variables**: model type, hyperparameters, data config
- **Dependent variables**: primary metric (e.g., perplexity, accuracy, loss), secondary metrics
- **Delta vs baseline**: always compute relative improvement

### Step 3: Statistical Analysis
- If multiple seeds: report mean +/- std, check reproducibility
- If sweeping a parameter: identify trends (monotonic, U-shaped, plateau)
- Flag outliers or suspicious results

### Step 4: Generate Insights
For each finding, structure as:
1. **Observation**: what the data shows (with numbers)
2. **Interpretation**: why this might be happening
3. **Implication**: what this means for the research question
4. **Next step**: what experiment would test the interpretation

### Step 5: Update Documentation
If findings are significant:
- Propose updates to project notes or experiment reports
- Draft a concise finding statement (1-2 sentences)

## Output Format
Always include:
1. Raw data table
2. Key findings (numbered, concise)
3. Suggested next experiments (if any)