Databricks Lead

Capgemini; Województwo mazowieckie; On-site; PLN 320,000 - 520,000; Full time

Benefits offered by this job

Yearly bonus

Private medical care

Life insurance

Training programs

Hybrid work model

Job summary

Capgemini Invent in Poland seeks a senior Databricks leader to own lakehouse architectures, guide end-to-end migrations, and steer a growing team of engineers across Azure, AWS and GCP. You will design workspace and Unity Catalog, drive cost optimization, set engineering standards, and present architectural choices and estimates to client executives.

Fluent English and 8+ years in data engineering required; experience in financial services or public sector is desirable.

Qualifications

• 8+ years in data engineering or data architecture with leadership.
• Proven delivery of at least two production lakehouse platforms end to end.
• Hands-on knowledge of Spark, Delta Lake, Unity Catalog, Lakeflow pipelines and jobs, Databricks SQL and MLflow; Terraform and Databricks Asset Bundles; CI/CD.
• Strong on one cloud (Azure preferred) and able to work on AWS or GCP.
• Experience with performance tuning and cost optimization of Databricks workloads; analytics and ML workloads are a plus.
• Databricks Certified Data Engineer Professional; additional certifications are a plus.
• Presales experience: solution design, estimation and client presentations; fluent English.
• Experience leading and developing engineers; highly desirable in financial services, energy, pharma or public sector.

Responsibilities

• Own the lakehouse architecture on client engagements: account and workspace design, networking and identity.
• Lead Databricks programmes end to end: migrations, lakehouse builds, platform hardening and cost reviews; set standards.
• Deliver data engineering, analytics and ML on the platform: ingestion, pipelines, Databricks SQL and AI/BI, MLflow and Mosaic AI.
• Lead and grow the Databricks engineering team: hiring, coaching, certification plan.
• Run the technical side of bids: solution design, estimates, proofs of concept, sizing and cost models.
• Ensure governance designs land in the platform: Unity Catalog access, lineage, data quality and model governance.
• Build reusable assets and stay aligned with the Databricks roadmap.

Job description

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting‑edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.

Your role

You will lead our Databricks team: the architecture, the delivery and the people. The team does the full range of Databricks work: greenfield lakehouse builds, migrations from legacy warehouses and Hadoop, data engineering and data products, analytics on Databricks SQL and AI/BI, machine learning and generative AI on Mosaic AI, platform operations and cost optimisation. You own the lakehouse design on every engagement, from the first workspace to data products and models in production, and you stay hands‑on in the parts that decide whether a platform holds: Unity Catalog, pipelines, security and cost. You lead a team of Databricks engineers that is growing fast and run the technical side of bids and estimates. Part of our work comes through our data and AI governance consultants, who define what a client's platform must guarantee: who owns which data, which rules apply, what evidence an auditor gets. On those engagements your team makes it true on Databricks. You will work across clouds (Azure first, AWS and GCP as clients need).

Your tasks

• Own the lakehouse architecture on client engagements: account and workspace design, networking and identity, Unity Catalog, data model, compute and cost strategy, CI/CD.
• Lead Databricks programmes end to end: migrations from legacy warehouses and Hadoop, greenfield lakehouse builds, platform hardening and cost reviews; set the engineering standards (code review, testing, Databricks Asset Bundles, Terraform).
• Deliver data engineering, analytics and ML on the platform: ingestion with Lakeflow Connect, pipelines and data products, Databricks SQL and AI/BI, machine learning and generative AI with MLflow and Mosaic AI; performance tuning and cost optimisation.
• Lead and grow the Databricks engineering team: hiring, technical coaching, certification plan, staffing across engagements.
• Run the technical side of bids: solution design, estimates, proofs of concept, sizing and cost models; present architecture choices and their cost to client architects and executives.
• On engagements with our Data & AI Governance practice, make sure governance designs land in the platform: access models in Unity Catalog, lineage and audit evidence, data quality in pipelines, model governance with MLflow.
• Build reusable assets: reference architectures, migration playbooks, ingestion and cost accelerators, platform standards, and the governance‑by‑design reference architecture developed with the governance team.
• Follow the Databricks roadmap (Lakeflow, Mosaic AI, AI/BI, Lakebase, serverless) and decide what we adopt, when and for which clients.

Your profile

• 8+ years in data engineering or data architecture, at least 4 of them on Databricks, including several years leading engineers or delivery teams.
• Proven delivery of at least two production lakehouse platforms end to end: platform setup, ingestion and pipelines, data model, analytics or ML consumption, operations.
• Deep hands‑on knowledge of Spark, Delta Lake, Unity Catalog, Lakeflow pipelines and jobs (formerly Delta Live Tables and Workflows), Databricks SQL and MLflow; infrastructure as code with Terraform and Databricks Asset Bundles; CI/CD.
• Strong on one cloud (Azure preferred) and able to work on AWS or GCP: networking, identity, storage, security and cost.
• Experience with performance tuning and cost optimisation of Databricks workloads; experience with analytics and ML workloads (Databricks SQL, AI/BI, Mosaic AI) is a plus.
• Databricks Certified Data Engineer Professional; further Databricks certifications or partner accreditations (e.g., Solutions Architect, Platform Administrator) are a plus.
• Presales experience: solution design, estimation and client presentations; ability to defend an architecture and its cost in front of executives.
• Experience leading and developing engineers; excellent communication skills; fluent English.
• Experience in financial services, energy, pharma or public sector is highly desirable.

What You'll Love About Working Here

• Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
• Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings.
• Cutting‑Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.
• Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.

Get to know us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued. Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube.

About Capgemini

Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end‑to‑end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market‑leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.

Make it real | www.capgemini.com