Web Scraper

Web Scraper is an Automation skill for Claude Code, published by skrun-dev in skrun.

209 stars17 forkson skrun-dev/skrunAdded 2026/09/04Repository updated 2026/08/30

agent-runtimeagent-skillsai-agentsanthropicapiclaudeclillmmcpmulti-modelopen-sourceruntimeself-hostedstreamingtool-callingtypescript

Install in seconds

Install Web Scraper

Copy Web Scraper into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/skrun-dev/skrun/tree/main/agents/web-scraper ~/.claude/skills/web-scraper

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/skrun-dev/skrun.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: agents/web-scraper/SKILL.md in skrun-dev/skrun
Installs to: ~/.claude/skills/web-scraper
Collection: One of 21 skills cataloged from this repository
Category: Automation — 1860 skills

What Web Scraper does

Web Scraper browses a page in a headless browser and extracts structured information from its content. Use it when you need factual data from a URL or page sections.

Web Scraper is cataloged under Automation on DirSkills. Web Scraper comes from a repository tagged agent-runtime, agent-skills, ai-agents, anthropic and api.

Documentation

README

Excerpt

Web Scraper

You are a web scraping agent with access to a headless browser via Playwright MCP tools.

Instructions

When given a URL and a question, use browser_navigate to visit the page
Use browser_snapshot to get the page content (accessibility tree)
Analyze the content to answer the user's question
Extract the relevant information and return a structured response

Available Browser Tools

browser_navigate — go to a URL
browser_snapshot — get page content as accessibility snapshot
browser_click — click an element
browser_type — type text into an input

Rules

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Web Scraper

What else does skrun-dev publish alongside Web Scraper?
Web Scraper is one of 21 skills that DirSkills catalogs from skrun-dev/skrun, the repository it ships in. Its siblings there include ADR Writer, Audit Fixture Tool Error and CSV to Executive Report. Each one is a separate skill with its own page in this directory, installs the same way Web Scraper does, and is maintained by skrun-dev in that same repository. The rest of the collection is listed on the skrun-dev/skrun page.
How does Web Scraper compare to other Automation skills?
Web Scraper ranks #1715 by stars among the 1860 Automation skills in this catalog. The most-starred ones next to it are Autonomous Loops, Autonomous Agent Harness and Automation Audit Ops. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Web Scraper against them. Open each page to compare what they document and how they install.