spark-engineering
Load for PySpark authoring, debugging or tuning — lazy evaluation and the action boundary, shuffle and partitioning, join strategy and skew, the UDF…
Skill by mogassama
Install
Works with Claude Code, Claude apps, Codex, Cursor, Gemini CLI, GitHub Copilot, VS Code, OpenCode, Goose, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install skill/mogassama-spark-engineering
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this skill can do and what it asks for, from its SKILL.md. Checked Oct 25, 2026.
- Tools
- No tools found
- Secrets
- None asked for
- Install scripts
- None found
Network hosts it talks to 1
codeload.github.com· found in install command
Files it touches
~/.claude/skills/spark-engineering
What's inside
- Skill name
spark-engineering- Description
- Load for PySpark authoring, debugging or tuning — lazy evaluation and the action boundary, shuffle and partitioning, join strategy and skew, the UDF hierarchy, caching discipline, Parquet I/O, notebook-specific pitfalls. Territory-scoped: SparkSession, DataFrame transformations, .parquet reads and writes, executor and shuffle configuration. Also load when a job on this engine is slow, skewed, or OOMing — the engine semantics are the answer, not the search method.
- License
- unknown
- Instructions
- 288 lines in SKILL.md · view on GitHub
Files (1)
- SKILL.md
The license isn't open source, so the instructions aren't shown here. Read SKILL.md on GitHub
More from mogassama/pi-agent-config
- 0.519score
bigquery-ops
mogassama
Load when the question is about operating a warehouse rather than writing a query against it — who is allowed to read what (authorized views, authorized…
SkillBFreshness: BClaude Code +9 - 0.519score
dataeng-architecture
mogassama
Load for system-level data engineering decisions on any platform — sizing, service selection, pipeline shape, layered modeling, idempotency, observability…
SkillBFreshness: BClaude Code +9 - 0.519score
gcp-engineering
mogassama
Load for operating GCP imperatively — identity and access (IAM roles, service accounts, ADC, impersonation), runtime configuration and deployment of compute…
SkillBFreshness: BClaude Code +9 - 0.519score
tdd
mogassama
Charge quand l'utilisateur veut piloter l'implémentation par les tests — boucle red-green-refactor, écrire le test qui échoue d'abord, conception de tests…
SkillBFreshness: BClaude Code +9 - 0.519score
dbt-engineering
mogassama
Load for work inside a dbt project — files under models/, macros/, seeds/ and snapshots/, plus dbt_project.yml, profiles.yml, schema.yml, and any dbt command.
SkillBFreshness: BClaude Code +9 - 0.519score
diagnose
mogassama
Charge quand quelque chose est cassé et que la cause est inconnue — boucle disciplinée de reproduction, bissection d'hypothèses, confirmation de la cause…
SkillBFreshness: BClaude Code +9 - 0.519score
gcp-dataeng-architecture
mogassama
Load when the platform is GCP and the question is which service to use for a data job — service selection, ingestion pipeline shape, BigQuery-centric…
SkillBFreshness: BClaude Code +9 - 0.519score
git-collaboration
mogassama
Load for git workflow tasks — security audit, staging, commit drafting, branch management, and config repo consistency check.
SkillBFreshness: BClaude Code +9 - 0.519score
iac-terraform
mogassama
Load for .tf and .tfvars files and terraform commands — HCL authoring and review, module structure, variable and output design, state and backend handling…
SkillBFreshness: BClaude Code +9 - 0.519score
sql-engineering
mogassama
Load for SQL craft that holds whatever the engine — naming, CTE structure, join discipline, explicit column lists, linting — and for the PostgreSQL dialect…
SkillBFreshness: BClaude Code +9 - 0.519score
airflow-engineering
mogassama
Load for files that are Airflow — anything under dags/, DAG and TaskFlow authoring, operator and sensor selection, schedule and catchup semantics, XCom, task…
SkillBFreshness: BClaude Code +9 - 0.519score
bigquery-engineering
mogassama
Load when writing or optimising a query that will run on BigQuery — partition and cluster filters, MERGE, deduplication, UNNEST, native JSON, numeric typing…
SkillBFreshness: BClaude Code +9
Signals
- Stars
- 0
- Forks
- 0
- Open issues
- 0
- Last commit (this folder)
- Aug 5, 2026 (2 months ago)
From GitHub (fetched Oct 24, 2026).
Details
- License
- License unknown
- Repository
- github.com/mogassama/pi-agent-config
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- GitHubgithub-graphql
More from mogassama
- 0.519score
bigquery-ops
mogassama
Load when the question is about operating a warehouse rather than writing a query against it — who is allowed to read what (authorized views, authorized…
SkillBFreshness: BClaude Code +9 - 0.519score
gcp-engineering
mogassama
Load for operating GCP imperatively — identity and access (IAM roles, service accounts, ADC, impersonation), runtime configuration and deployment of compute…
SkillBFreshness: BClaude Code +9 - 0.519score
tdd
mogassama
Charge quand l'utilisateur veut piloter l'implémentation par les tests — boucle red-green-refactor, écrire le test qui échoue d'abord, conception de tests…
SkillBFreshness: BClaude Code +9 - 0.519score
dataeng-architecture
mogassama
Load for system-level data engineering decisions on any platform — sizing, service selection, pipeline shape, layered modeling, idempotency, observability…
SkillBFreshness: BClaude Code +9 - 0.519score
airflow-engineering
mogassama
Load for files that are Airflow — anything under dags/, DAG and TaskFlow authoring, operator and sensor selection, schedule and catchup semantics, XCom, task…
SkillBFreshness: BClaude Code +9 - 0.519score
bigquery-engineering
mogassama
Load when writing or optimising a query that will run on BigQuery — partition and cluster filters, MERGE, deduplication, UNNEST, native JSON, numeric typing…
SkillBFreshness: BClaude Code +9
Cite this page
spark-engineering skill. Agent Mart. https://agentmart.dev/skills/mogassama-spark-engineering (last updated 2026-10-24)