databricks-pipelines
Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.
Skill by databricksOfficial
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/databricks-databricks-pipelines-8c65e8
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: backend, data
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions: not checked yet.
What's inside
- Skill name
databricks-pipelines- Description
- Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks. Use when building batch or streaming data pipelines with Python or SQL, including Auto CDC from event streams or periodic complete snapshots. Invoke BEFORE starting implementation.
- License
- NOASSERTION
- Compatibility
- Requires databricks CLI (>= v1.0.0)
- Metadata
- version: 0.3.0
- Instructions
- 261 lines in SKILL.md · view on GitHub
Files (37)
- SKILL.md
- openai.yaml · agents/
- databricks.png · assets/
- databricks.svg · assets/
- 1-project-initialization-with-dab.md · references/
- 2-rapid-iteration-with-cli.md · references/
- auto-cdc-python.md · references/
- auto-cdc-sql.md · references/
- auto-loader-python.md · references/
- auto-loader-sql.md · references/
- dlt-migration.md · references/
- expectations-python.md · references/
- expectations-sql.md · references/
- foreach-batch-sink-python.md · references/
- kafka.md · references/
- materialized-view-python.md · references/
- materialized-view-sql.md · references/
- options-avro.md · references/
- options-csv.md · references/
- options-json.md · references/
- options-orc.md · references/
- options-parquet.md · references/
- options-text.md · references/
- options-xml.md · references/
- performance.md · references/
- pipeline-configuration.md · references/
- python-basics.md · references/
- real-time-mode.md · references/
- scd-2-querying.md · references/
- sink-python.md · references/
- sql-basics.md · references/
- streaming-patterns.md · references/
- streaming-table-python.md · references/
- streaming-table-sql.md · references/
- temporary-view-python.md · references/
- temporary-view-sql.md · references/
- view-sql.md · references/
The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub
More from databricks/databricks-agent-skills
- 0.659score
databricks-lakebase
databricksOfficial
Databricks Lakebase Postgres: projects, scaling, connectivity, Lakebase synced tables, and Data API.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-iceberg
databricksOfficial
Apache Iceberg tables on Databricks — Managed Iceberg tables, External Iceberg Reads (fka Uniform), Compatibility Mode, Iceberg REST Catalog (IRC), Iceberg…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-genie-agents
databricksOfficial
Create, manage, and query Databricks Genie Agents — curated, per-data natural-language agents (formerly Genie Spaces): build, export/import, migrate across…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-jobs
databricksOfficial
Develop and deploy Lakeflow Jobs on Databricks via DABs, Python SDK, or the CLI.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-ai-functions
databricksOfficial
Use Databricks built-in AI Functions (ai_classify, ai_extract, ai_summarize, ai_mask, ai_translate, ai_fix_grammar, ai_gen, ai_analyze_sentiment…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-apps-python
databricksOfficial
Python backend for Databricks Apps — FastAPI (default), Flask, Dash, Streamlit, Gradio, Reflex.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
spark-python-data-source
databricksOfficial
Build custom Python data sources for Apache Spark using the PySpark DataSource API — batch and streaming readers/writers for external systems.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-dabs
databricksOfficial
Create, configure, validate, deploy, run, and manage Declarative Automation Bundles (DABs, formerly Databricks Asset Bundles).
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-app-design
databricksOfficial
Design the UX of custom-code Databricks Apps (AppKit/React) data screens — KPI/overview pages, reports, charts, tables, and Genie/chat data assistants —…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-dbsql
databricksOfficial
Databricks SQL (DBSQL) advanced features and SQL warehouse capabilities.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-apps
databricksOfficial
Build apps on Databricks Apps platform.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-lakeflow-connect
databricksOfficial
Build managed ingestion pipelines into Databricks using Lakeflow Connect.
SkillAFreshness: A★ 369Claude Code +9
Signals
- Stars
- 369
- Forks
- 94
- Open issues
- 34
- Last commit (this folder)
- Oct 18, 2026 (11 days ago)
- Last release
- Oct 23, 2026 (6 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- Version
- 0.3.0
- License
- NOASSERTION
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
Same skill elsewhere
Copies of this SKILL.md published by others; search shows only one of them.
- 0.659score
databricks-pipelines
databricksOfficial
Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.
SkillAFreshness: A★ 369Claude Code +9 - 0.344score
databricks-pipelines
databricksOfficial
Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.
SkillAFreshness: A★ 369Claude Code +9 - 0.344score
databricks-pipelines
databricksOfficial
Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.
SkillAFreshness: A★ 369Claude Code +9 - 0.344score
databricks-pipelines
databricksOfficial
Develop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks.
SkillAFreshness: A★ 369Claude Code +9
More from databricks
- 0.659score
databricks-apps-python
databricksOfficial
Python backend for Databricks Apps — FastAPI (default), Flask, Dash, Streamlit, Gradio, Reflex.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-ai-functions
databricksOfficial
Use Databricks built-in AI Functions (ai_classify, ai_extract, ai_summarize, ai_mask, ai_translate, ai_fix_grammar, ai_gen, ai_analyze_sentiment…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
spark-python-data-source
databricksOfficial
Build custom Python data sources for Apache Spark using the PySpark DataSource API — batch and streaming readers/writers for external systems.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-app-design
databricksOfficial
Design the UX of custom-code Databricks Apps (AppKit/React) data screens — KPI/overview pages, reports, charts, tables, and Genie/chat data assistants —…
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-apps
databricksOfficial
Build apps on Databricks Apps platform.
SkillAFreshness: A★ 369Claude Code +9 - 0.659score
databricks-dabs
databricksOfficial
Create, configure, validate, deploy, run, and manage Declarative Automation Bundles (DABs, formerly Databricks Asset Bundles).
SkillAFreshness: A★ 369Claude Code +9
Cite this page
databricks-pipelines skill. Agent Mart. https://agentmart.dev/skills/databricks-databricks-pipelines-8c65e8 (last updated 2026-10-24)