“Data pipelines”

Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Design and implement repeatable preprocessing pipelines for cleaning, encoding, transforming, and validating ML input data.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

Data and Database Engineer expert in schema design, query optimization, and data pipelines.

Scans AI training data pipelines and datasets to detect bias, data poisoning, label corruption, and statistical anomalies that could compromise autonomous AI…

Creates, configures, and updates Databricks Lakeflow Spark Declarative Pipelines (SDP/LDP) using serverless compute.

Build a real-time change-data-capture pipeline from a transactional database (Aurora DSQL, Aurora Postgres, RDS) to Redshift Serverless, S3, or any other…

Render and lint reusable SPL2 pipeline templates for Cisco Data Fabric, Splunk Ingest Processor, and Edge Processor, including routing, redaction, sampling…

Programmatic page generation at scale using template-based SEO and data pipelines: keyword pattern mining, template architecture, and indexation for 100-100K+…

Mutation testing for a data pipeline's quality checks: generates deliberately corrupted copies of a dataset (duplicated samples, dropped rows, shuffled…

Answer HubSpot sales pipeline and funnel questions using Fivetran-synced HubSpot data via BigQuery, Snowflake, or Databricks.

Discovers and inspects BigQuery Data Transfer Service (DTS) configurations.

Flow.bio API bridge — authenticate, browse pipelines/samples/projects, search, upload data, launch pipeline executions, and check run status on any Flow…

Data engineering for batch and streaming pipelines with Airflow, dbt, Spark, and Kafka.

Autonomously improve a real artifact (code, training recipe, agent harness, data pipeline, prompt) against an objective and an evaluator, using Hypothesis…

Use when the user wants to create a dataset, generate synthetic data, or build a data generation pipeline.

Use for RAG pipelines, retrieval augmented generation, ColBERTv2, context retrieval, multi-hop RAG, and grounded DSPy answers.

Use for web scraping, crawling, document extraction, API parsing, or building validation-heavy data pipelines using Firecrawl or local Python scripts.

Profile a DeepStream pipeline with Nsight Systems and derive its configs from the measurement.

Comprehensive data visualization toolkit for creating beautiful, mathematically elegant visualizations with D3.js, Chart.js, and custom SVG.

End-to-end GWAS automation wrapping PLINK2 for genotype QC and REGENIE for two-step whole-genome regression association testing.

Pipeline templates for scheduled investment workflows.

Automated data quality and transformation capabilities for Dataform/dbt/BigQuery pipelines.