(Senior) Databricks Engineer

Capgemini; Województwo mazowieckie; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Yearly financial bonus

Private medical care

Life insurance

Hybrid work model

Training & certification opportunities

Job summary

Capgemini Invent Poland is seeking a senior data engineer to build lakehouse platforms on Databricks end-to-end, from workspace setup to data products for analytics and ML. You will own pipelines, data models and parts of the platform, collaborating with clients and Capgemini teams to design scalable solutions.

You will work across platform setup, ingestion, transformations and governance, with a focus on cost control, performance and delivering tangible business outcomes.

Qualifications

• 3+ years in data engineering with at least one year on Databricks in production.
• Strong Spark and SQL skills, with Python experience.
• Experience with cloud platforms (Azure preferred) and Git/CI/CD.

Responsibilities

• Set up and configure Databricks platforms, workspaces and networking.
• Build ingestion and pipelines with Lakeflow, Auto Loader, and Delta Lake.
• Model data for analytics and ML with Databricks SQL dashboards.
• Migrate workloads from legacy warehouses and notebooks.
• Apply CI/CD and IaC with Terraform.
• Monitor, tune performance and manage costs across clusters.
• Support governance: data quality, lineage, Unity Catalog access.
• Senior level: guide design and lead workstreams.

Skills

Spark (PySpark/Scala)

SQL

Python

Delta Lake

Databricks

Git

Education

Databricks Certified Data Engineer Associate

Bachelor's degree in CS or related field

Tools

Terraform

Databricks Asset Bundles

Lakeflow

Unity Catalog

Job description

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.

Your role

You will build lakehouse platforms on Databricks for our clients, end to end: workspace and platform setup, ingestion, pipelines, data model, data products for analytics and machine learning, and the operations that keep it all running. Our engineers are not split into platform people and pipeline people; you cover the whole stack and grow across it. As an engineer you own pipelines, data products and parts of the platform inside a workstream. As a senior engineer you own the technical design of a workstream or of a whole platform, review the work of the other engineers and are the person the client's architects talk to. You will work with the Databricks Lead on architecture, with the Senior Databricks Engineer - Governance when governance is part of the engagement, and with the client's data teams every day. We hire at both levels on this description; what changes is the share of design and review versus building.

Your tasks

• Set up and configure Databricks platforms: workspaces, compute policies, Unity Catalog basics, networking and identity with the platform team; at senior level, own the platform design and its cost model.
• Build ingestion and pipelines: Lakeflow Connect and Auto Loader, Lakeflow pipelines in batch and streaming, Spark and SQL transformations, Delta Lake tables in a medallion model; at senior level, set the patterns the other engineers follow.
• Model data for consumption: data products, Databricks SQL and AI/BI dashboards, feature tables and model serving with MLflow; at senior level, decide the modelling approach with the client.
• Migrate workloads from legacy warehouses, Hadoop or notebooks to Databricks; refactor what cannot be migrated as it is.
• Engineer like software: Git, CI/CD with Databricks Asset Bundles, infrastructure as code with Terraform, automated tests, code review; at senior level, run the reviews and own the release process.
• Run and optimise: monitoring, job orchestration, performance tuning, cost control (cluster sizing, serverless, Photon, query tuning).
• Support the governance layer where the engagement includes it: data quality expectations in pipelines, lineage, access requests in Unity Catalog, together with the governance engineer.
• At senior level: estimate and plan workstreams, support bids with the Databricks Lead, coach engineers and keep certifications current across the team.

Your profile

• Engineer: 3+ years in data engineering, with at least one year hands-on on Databricks in production. Senior Engineer: 5+ years, at least three on Databricks, with hands‑on work in at least three of: platform setup, batch and streaming pipelines, data modelling, migration, CI/CD and infrastructure as code, performance and cost tuning, and a track record of leading the technical side of a workstream.
• Strong Spark (PySpark or Scala) and SQL; Python; Delta Lake; Lakeflow pipelines and jobs; Databricks SQL.
• Working knowledge of one cloud (Azure preferred; AWS or GCP): storage, identity and networking as they apply to Databricks.
• Git and CI/CD; experience with Databricks Asset Bundles or Terraform (both, at senior level).
• Databricks Certified Data Engineer Associate held or in progress (Professional, at senior level).
• Unity Catalog basics: catalogs, permissions, lineage; interest in data governance is a plus.
• Clear communication with client data teams; fluent English; at senior level, the ability to present a technical design to client architects.
• Experience in financial services, energy, pharma or public sector is a plus.

What You'll Love About Working Here

• Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
• Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings.
• Cutting-Edge Technology: Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.
• Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.

Get to know us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.

Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube.

About Capgemini

Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market‑leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.

Make it real | www.capgemini.com