Web Scraping

Web Scraping is an Automation skill for Claude Code, published by billy-enrizky in openbrowser-ai.

241 stars21 forkson billy-enrizky/openbrowser-aiAdded 2026/09/02Repository updated 2026/07/07

agent-skillsaiai-agentsai-browserai-browser-automationartificial-intelligencebrowser-automationclaude-codeclaude-code-skills

Install in seconds

Install Web Scraping

Copy Web Scraping into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/billy-enrizky/openbrowser-ai/tree/main/plugin/skills/web-scraping ~/.claude/skills/web-scraping

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/billy-enrizky/openbrowser-ai.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: plugin/skills/web-scraping/SKILL.md in billy-enrizky/openbrowser-ai
Installs to: ~/.claude/skills/web-scraping
Collection: One of 7 skills cataloged from this repository
Category: Automation — 1648 skills

What Web Scraping does

Web Scraping extracts structured data from websites using browser automation and Python. Use it to scrape rendered pages, handle pagination, and collect content across multiple URLs.

Web Scraping is cataloged under Automation on DirSkills. Web Scraping comes from a repository tagged agent-skills, ai, ai-agents, ai-browser and ai-browser-automation.

Documentation

README

Excerpt

Web Scraping

Extract structured data from websites using Python code execution with browser automation functions. Handles JavaScript-rendered content, pagination, and multi-page scraping.

All code runs via openbrowser-ai -c. The daemon starts automatically and persists variables across calls. All browser functions are async -- use await.

The CLI daemon also persists cookies and login state in ~/.config/openbrowser/profiles/daemon/storage_state.json, so authenticated sessions can be reused across later runs.

Setup

Before running, verify openbrowser-ai is installed:

openbrowser-ai --help

If not found, install:

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Web Scraping

What else does billy-enrizky publish alongside Web Scraping?
Web Scraping is one of 7 skills that DirSkills catalogs from billy-enrizky/openbrowser-ai, the repository it ships in. Its siblings there include Accessibility Audit, Deep Research and End-to-End Testing. Each one is a separate skill with its own page in this directory, installs the same way Web Scraping does, and is maintained by billy-enrizky in that same repository. The rest of the collection is listed on the billy-enrizky/openbrowser-ai page.
How does Web Scraping compare to other Automation skills?
Web Scraping ranks #1503 by stars among the 1648 Automation skills in this catalog. The most-starred ones next to it are Autonomous Loops, Autonomous Agent Harness and Automation Audit Ops. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Web Scraping against them. Open each page to compare what they document and how they install.