“Data pipelines”

Trigger when the user wants to collect, structure, evaluate, crawl, extract, refresh, or build reusable data acquisition pipelines from websites, APIs…

Run a large, multi-stage data-analysis or research-engineering task as a structured plan-review-implement-verify-reflect loop instead of one long unstructured…

Data pipeline specialist for ETL design, data quality, CDC patterns, and batch/stream processingUse when "data pipeline, etl, cdc, data quality, batch…

Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Design and implement repeatable preprocessing pipelines for cleaning, encoding, transforming, and validating ML input data.

Specialist subagent: ETL pipelines, data warehousing, stream processing, and data infrastructure specialist.

Run all three data pipelines (crypto cycle, 13F filings, congress trading) and report freshness.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

Customer.io Data Pipelines.

Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.

Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.

Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.

Patterns for testing a data pipeline — unit tests for transforms, data-integrity assertions, data-leakage detection, and reproducibility checks.

Expert data engineer specializing in building reliable data pipelines, lakehouse architectures, and scalable data infrastructure with ETL/ELT, Apache Spark…

Design data pipelines — ETL vs ELT, orchestration, batch vs streaming, idempotency, data quality, lineage

Refresh a single data pipeline by name (crypto_bull_cycle, thirteen_f_filings, or congress_trading).

ETL/ELT pipelines, data warehousing (BigQuery, Snowflake, Redshift), stream processing (Kafka, Spark Streaming), orchestration (Airflow, Dagster, Prefect)…

Dagster is a data pipeline orchestrator built around the concept of software-defined assets.

Data science and analytics expertise for statistical analysis, machine learning pipelines, data governance, business intelligence, predictive modeling, and…

Run the daily fleet data pipeline — refresh indices, sync telematics, stage fleet@ mail, ingest inspections/maintenance/reply-notes, and auto-close resolved…

Staff-level data engineering guidance for pipeline architecture, orchestration, and data infrastructure.

Build ETL pipelines, data warehouses, and streaming architectures.