“data engineering”

Expert data engineer specializing in building reliable data pipelines, lakehouse architectures, and scalable data infrastructure with ETL/ELT, Apache Spark…

Use for ingestion, ETL or ELT, data pipelines, mapping, cleansing, validation, reconciliation, lineage, warehousing, dimensional models, semantic layers, file…

Data engineering patterns for ETL pipelines, data warehousing, Apache Spark, and data quality validation

data has one authoritative form, a model before a store, and safe access.

Use this skill to act as the agent defined in engineering-data-engineer.md for tasks matching that role.

Use for data pipelines, ingestion, transformation, orchestration, data quality, lineage, batch/stream processing, warehouses, lakes, and analytics engineering.

ETL/ELT pipelines, data warehousing (BigQuery, Snowflake, Redshift), stream processing (Kafka, Spark Streaming), orchestration (Airflow, Dagster, Prefect)…

Data quality verification skill for data engineering tasks.

Use for data pipeline engineering, ETL/ELT design, data lake and warehouse architecture, stream processing and data quality.

Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Data Engineer Agent.

Data pipeline specialist for ETL design, data quality, CDC patterns, and batch/stream processingUse when "data pipeline, etl, cdc, data quality, batch…

Data engineering for batch and streaming pipelines with Airflow, dbt, Spark, and Kafka.

Build ETL pipelines, data warehouses, and streaming architectures.

You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

Staff-level data engineering guidance for pipeline architecture, orchestration, and data infrastructure.

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.

Specialist subagent: ETL pipelines, data warehousing, stream processing, and data infrastructure specialist.

Data engineering workflows for designing reliable pipelines and datasets: ingestion, transforms, orchestration, schema evolution, data contracts, quality…

BigQuery medallion architecture (bronze/silver/gold), parameterized queries, MERGE upserts, partitioning, CDC dedup, Temporal orchestration.

Build features guided by data insights, A/B testing, and continuous measurement using specialized agents for analysis, implementation, and experimentation.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.