Scrapling

by fengshao1227

Scrapling is an Automation skill for Claude Code, published by fengshao1227 in ccg-workflow.

5.8K stars443 forkson fengshao1227/ccg-workflowAdded 2026/08/15Repository updated 2026/08/12

View source on GitHub Download repo ZIP

agent-teamsaiccgclaude-codeclicodexgeminillmno-denodejsopsxspecpromptworkflow

Install in seconds

Install Scrapling

Copy Scrapling into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/fengshao1227/ccg-workflow/tree/main/templates/skills/scrapling ~/.claude/skills/scrapling

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/fengshao1227/ccg-workflow.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: templates/skills/scrapling/SKILL.md in fengshao1227/ccg-workflow
Installs to: ~/.claude/skills/scrapling
Collection: One of 25 skills cataloged from this repository
Category: Automation — 1523 skills

What Scrapling does

Scrapling fetches and extracts data from web pages, automatically selecting the right fetcher for static pages, Cloudflare/WAF bypass, session login, and HTML parsing. Use it when users ask to scrape, crawl, fetch pages, extract data, or bypass Cloudflare.

Scrapling is cataloged under Automation on DirSkills. Scrapling comes from a repository tagged agent-teams, ai, ccg, claude-code and cli.

Documentation

README

Excerpt

Scrapling 网页抓取 Skill

步骤 0：检查版本

pip show scrapling

未安装 → 执行 pip install "scrapling[fetchers]" + scrapling install
有新版 → 执行 pip install --upgrade "scrapling[fetchers]" → 查 changelog 告知用户
已最新 → 继续

步骤 1：选择 Fetcher

目标网站 →
│
├─ 已有 HTML 字符串/文件，只需解析?
│   → Selector（纯解析，无网络请求）
│   → 模板: templates/parse_only.py
│
├─ 静态页面，无 JS 渲染，无反爬?
│   → Fetcher（最快，基于 curl_cffi）
│   → 模板: templates/basic_fetch.py
│
├─ 需要登录（HTTP 表单，非 JS 登录）?
│   → FetcherSession（保持会话 cookie）
│   → 模板: templates/session_login.py
│
├─ 有 Cloudflare / WAF 保护?
│   → StealthyFetcher（Camoufox 浏览器，自动过 CF）
│   → 模板: templates/stealth_cloudflare.py
│
├─ SPA 应用（React/Vue），需要 JS 渲染?
│   → DynamicFetcher（Playwright 浏览器）
│   → 基于模板即时生成
│
└─ 不确定?
    → 先用 Fetcher 试，403/空内容 → 升级到 StealthyFetcher

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Scrapling

What else does fengshao1227 publish alongside Scrapling?
Scrapling is one of 25 skills that DirSkills catalogs from fengshao1227/ccg-workflow, the repository it ships in. Its siblings there include AI Capability Index, Adaptive Design and Animate. Each one is a separate skill with its own page in this directory, installs the same way Scrapling does, and is maintained by fengshao1227 in that same repository. The rest of the collection is listed on the fengshao1227/ccg-workflow page.
How does Scrapling compare to other Automation skills?
Scrapling ranks #233 by stars among the 1523 Automation skills in this catalog. The most-starred ones next to it are Autonomous Loops, Autonomous Agent Harness and Automation Audit Ops. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Scrapling against them. Open each page to compare what they document and how they install.