“Data pipelines”

Data pipeline patterns: ingestion, ETL, serialisation, partitioned reads/writes, file conversion, parallel batch processing, Lambda-triggered ingestion.

Primary entry point for building, managing, and orchestrating data pipelines on Google Cloud.

Guide a developer through building a Solana data pipeline or indexer.

MANDATORY when building data processing pipelines or consuming message queues.

Garante o fluxo correto de dados desde APIs externas até ao utilizador — cache em camadas, fallbacks inteligentes, transformação de dados, sem dados stale ou…

Build and manage input/output pipelines for the Discovery Engine

Designs and builds ETL/ELT data pipelines.

Design and implement data pipelines for ML workflows.

Design or review data pipeline correctness, lineage, quality, and replay behavior.

Build data and AI infrastructure.

Designs ETL/ELT data pipelines with proper extraction, transformation, and loading patterns, including orchestration, error handling, and data quality…

You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing.

Plan and operate repeatable batch or VM data pipelines with preflight checks, resource gates, safe stop, recovery, and evidence.

Build data ingestion pipelines for batch and streaming data from multiple sources.

Build end-to-end data pipelines that fetch, analyze, synthesize, and visualize intelligence from Slack channels, documents, and other sources using…

ETL/ELT patterns, batch vs streaming, idempotency, data quality framework, and pipeline orchestration

Use when the user wants a production-grade scraping/API/browser pipeline design or implementation plan: pipeline.yaml, schemas, raw/staged/normalized outputs…

Run a large, multi-stage data-analysis or research-engineering task as a structured plan-review-implement-verify-reflect loop instead of one long unstructured…

Data pipeline specialist for ETL design, data quality, CDC patterns, and batch/stream processingUse when "data pipeline, etl, cdc, data quality, batch…

Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Design and implement repeatable preprocessing pipelines for cleaning, encoding, transforming, and validating ML input data.

Specialist subagent: ETL pipelines, data warehousing, stream processing, and data infrastructure specialist.

Run all three data pipelines (crypto cycle, 13F filings, congress trading) and report freshness.

Customer.io Data Pipelines.