A/B Test Setup

A/B Test Setup is a Quality skill for Claude Code, published by sickn33 in agentic-awesome-skills.

44.5K stars6.5K forkson sickn33/agentic-awesome-skillsAdded 2026/07/19+1% in starsRepository updated 2026/08/05

agent-skillsagentic-skillsai-agent-skillsai-agentsai-codingai-workflowsantigravityantigravity-skillsclaude-codeclaude-code-skillscodex-clicodex-skillscursorcursor-skillsdeveloper-toolsgemini-cligemini-skillskiromcpskill-library

Install in seconds

Install A/B Test Setup

Copy A/B Test Setup into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/sickn33/agentic-awesome-skills/tree/main/plugins/agentic-awesome-skills-claude/skills/ab-test-setup ~/.claude/skills/ab-test-setup

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/sickn33/agentic-awesome-skills.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: plugins/agentic-awesome-skills-claude/skills/ab-test-setup/SKILL.md in sickn33/agentic-awesome-skills
Installs to: ~/.claude/skills/ab-test-setup
Collection: One of 26 skills cataloged from this repository
Category: Quality — 1897 skills

What A/B Test Setup does

A structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness, ensuring statistical rigor and valid experiment design.

A/B Test Setup is cataloged under Quality on DirSkills. A/B Test Setup comes from a repository tagged agent-skills, agentic-skills, ai-agent-skills, ai-agents and ai-coding.

Documentation

README

Excerpt

A/B Test Setup

1️⃣ Purpose & Scope

Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.

Prevents "peeking"
Enforces statistical power
Blocks invalid hypotheses

2️⃣ Pre-Requisites

You must have:

A clear user problem
Access to an analytics source
Roughly estimated traffic volume

Hypothesis Quality Checklist

A valid hypothesis includes:

Observation or evidence
Single, specific change
Directional expectation
Defined audience
Measurable success criteria

3️⃣ Hypothesis Lock (Hard Gate)

Before designing variants or metrics, you MUST:

Present the final hypothesis
Specify:
- Target audience
- Primary metric
- Expected direction of effect
- Minimum Detectable Effect (MDE)

This is the opening of the README. Read the full README on GitHub.

Frequently asked about A/B Test Setup

What else does sickn33 publish alongside A/B Test Setup?
A/B Test Setup is one of 26 skills that DirSkills catalogs from sickn33/agentic-awesome-skills, the repository it ships in. Its siblings there include 007 Security Audit, 2Slides Presentation Generator and 3D Web Experience. Each one is a separate skill with its own page in this directory, installs the same way A/B Test Setup does, and is maintained by sickn33 in that same repository. The rest of the collection is listed on the sickn33/agentic-awesome-skills page.
How does A/B Test Setup compare to other Quality skills?
A/B Test Setup ranks #55 by stars among the 1897 Quality skills in this catalog. The most-starred ones next to it are Benchmark, Benchmark Optimization Loop and API Design Patterns. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of A/B Test Setup against them. Open each page to compare what they document and how they install.