Data Engineering

by fengshao1227

Data Engineering is a Data skill for Claude Code, published by fengshao1227 in ccg-workflow.

5.8K stars443 forkson fengshao1227/ccg-workflowAdded 2026/08/15Repository updated 2026/08/12

View source on GitHub Download repo ZIP

agent-teamsaiccgclaude-codeclicodexgeminillmno-denodejsopsxspecpromptworkflow

Install in seconds

Install Data Engineering

Copy Data Engineering into your Claude Code skills folder. Run the command in your terminal, or review the source on GitHub before installing.

terminal

npx degit https://github.com/fengshao1227/ccg-workflow/tree/main/templates/skills/domains/data-engineering ~/.claude/skills/data-engineering

Requires Node.js. Downloads this skill only — not the rest of the repository — into your Claude Code skills folder.

Without Node.js

git clone https://github.com/fengshao1227/ccg-workflow.git

Clones the whole repository, then copy the skill’s own directory into your skills folder yourself.

In this catalog

Source file: templates/skills/domains/data-engineering/SKILL.md in fengshao1227/ccg-workflow
Installs to: ~/.claude/skills/data-engineering
Collection: One of 25 skills cataloged from this repository
Category: Data — 668 skills

What Data Engineering does

Data Engineering provides patterns and guidance for data pipelines, stream processing, and data quality using tools like Airflow, Dagster, Kafka Streams, Flink, dbt, and Great Expectations. Use it for ETL, data orchestration, streaming, or validation tasks.

Data Engineering is cataloged under Data on DirSkills. Data Engineering comes from a repository tagged agent-teams, ai, ccg, claude-code and cli.

Documentation

README

Excerpt

数据工程域 · Data Engineering

域概览

数据工程域涵盖数据管道编排、流式处理、数据质量保障三大核心领域。

数据管道层                流处理层              质量保障层
├── Airflow (调度编排)    ├── Kafka Streams     ├── Great Expectations
├── Dagster (资产管理)    ├── Flink             ├── dbt
└── Prefect (现代工作流)  └── Spark Streaming   └── Soda Core

数据管道编排

框架对比

特性	Airflow	Dagster	Prefect
核心模型	DAG + Task	Asset + Op	Flow + Task
学习曲线	陡峭	中等	平缓
资产管理	无	原生支持	无
动态任务	支持	支持	支持
本地开发	复杂	简单	简单
社区生态	最大	成长中	成长中

Airflow 核心模式

This is the opening of the README. Read the full README on GitHub.

Frequently asked about Data Engineering

What else does fengshao1227 publish alongside Data Engineering?
Data Engineering is one of 25 skills that DirSkills catalogs from fengshao1227/ccg-workflow, the repository it ships in. Its siblings there include AI Capability Index, Adaptive Design and Animate. Each one is a separate skill with its own page in this directory, installs the same way Data Engineering does, and is maintained by fengshao1227 in that same repository. The rest of the collection is listed on the fengshao1227/ccg-workflow page.
How does Data Engineering compare to other Data skills?
Data Engineering ranks #167 by stars among the 668 Data skills in this catalog. The most-starred ones next to it are Benchmark Methodology, Jupyter Notebook and Solana. DirSkills ranks by the star count of the repository each skill ships in, so that order reflects how popular those repositories are rather than any review of Data Engineering against them. Open each page to compare what they document and how they install.