Senior Databricks Platform Engineer, Lakehouse & End-to-End

Capgemini; Polska; Hybrid; PLN 260,000 - 380,000; Full time

Benefits offered by this job

Annual bonus

Private medical care

Life insurance

Training & certifications

Hybrid work

Job summary

Capgemini is seeking a (Senior) Databricks Engineer in Warsaw to build end-to-end lakehouse platforms, data pipelines and analytics products for diverse clients. You will own platform design, pipelines and data models, collaborating with client teams and governance specialists.

Senior roles involve leading workstreams, design reviews and release ownership. Ideal candidates have strong Spark/SQL, Python, Delta Lake, and cloud experience (Azure preferred).

Qualifications

• 3+ years in data engineering, with at least one year hands-on on Databricks in production.
• 5+ years for senior level, with hands-on work in platform setup, pipelines, data modelling, migration, CI/CD and IaC.

Responsibilities

• Set up and configure Databricks platforms: workspaces, compute policies, Unity Catalog basics, networking and identity with the platform team; at senior level, own the platform design and its cost model.
• Build ingestion and pipelines: Lakeflow Connect and Auto Loader, Lakeflow pipelines in batch and streaming, Spark and SQL transformations, Delta Lake tables in a medallion model.
• Model data for consumption: data products, Databricks SQL and AI/BI dashboards, feature tables and model serving with MLflow.
• Migrate workloads from legacy warehouses, Hadoop or notebooks to Databricks; refactor what cannot be migrated as it is.
• Engineer like software: Git, CI/CD with Databricks Asset Bundles, infrastructure as code with Terraform, automated tests, code review; at senior level, run the reviews and own the release process.
• Run and optimise: monitoring, job orchestration, performance tuning, cost control.

Tools

Spark

PySpark/Scala

SQL

Python

Delta Lake

Lakeflow

Databricks SQL

Azure

Git

CI/CD

Terraform

Databricks Asset Bundles

Unity Catalog

Databricks Certification

Job description

Capgemini is seeking a (Senior) Databricks Engineer in Warsaw to build end-to-end lakehouse platforms, data pipelines and analytics products for diverse clients. You will own platform design, pipelines and data models, collaborating with client teams and governance specialists.

Senior roles involve leading workstreams, design reviews and release ownership. Ideal candidates have strong Spark/SQL, Python, Delta Lake, and cloud experience (Azure preferred).