Senior Databricks Engineer - Governance

Capgemini; Polska; Hybrid; PLN 320,000 - 520,000; Full time

Benefits offered by this job

Yearly financial bonus

Private medical care (Medicover)

Life insurance

NAIS benefit platform

Over 70 training tracks

Hybrid working model

Job summary

Capgemini Invent in Warsaw is seeking a Senior Databricks Engineer to own the governance layer of client platforms. You will design Unity Catalog structures, implement access models, and generate governance evidence across pipelines, with collaboration across data governance and AI teams.

We value 5+ years in Databricks, Unity Catalog design, Spark/SQL/Python, and IaC with Terraform. A Databricks certification and cloud security knowledge are a plus; hybrid work arrangement available in Poland.

Qualifications

• 5+ years of hands-on Databricks engineering in production.
• At least two years designing and administering Unity Catalog at enterprise scale.
• Strong Spark, SQL and Python; Delta Lake and Lakeflow pipelines.
• IaC experience with Terraform and Databricks Asset Bundles.
• Working knowledge of cloud security for Databricks (Azure or AWS).
• Databricks Certification; Platform Administrator accreditation is a plus.
• Fluent English; ability to explain complex models to non-technical stakeholders.

Responsibilities

• Design and implement Unity Catalog structures: metastore, catalog, bindings.
• Build access control reflecting governance design: groups, filters, masks.
• Produce governance evidence: lineage, audit logs, dashboards for owners.
• Migrate Hive metastore and legacy permissions to Unity Catalog.
• Collaborate with data governance, AI governance, and sovereignty teams.
• Develop reusable assets: Terraform code and Databricks Asset Bundles.

Skills

Unity Catalog design

Access control design

Spark/SQL/Python

Terraform

Databricks Asset Bundles

Lakeflow pipelines

Data governance

Education

Databricks Certified Data Engineer Professional

Tools

Unity Catalog

Purview

Collibra

Delta Lake

Job description

# Senior Databricks Engineer - GovernanceWarszawaApply for this job* Permanent* Experienced Professionals* Strategy & Transformation* ID 580628-en\\_GB##At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.## **Your role**You will be a senior Databricks engineer who owns the governance layer of the platforms we build. On Databricks engagements you work as any senior engineer does, on pipelines, data model and platform setup, and you take charge of Unity Catalog, access and evidence. On governance engagements, our data and AI governance consultants decide what good looks like for a client: who owns which data, who may see what, which quality rules apply, what an auditor needs to see. You make it true in Unity Catalog and in the pipelines around it: metastore and catalog design, access models that hold (groups, row filters, column masks, tag-based policies), lineage and audit evidence pulled from system tables, data quality checks inside pipelines, models and AI assets governed through Unity Catalog and MLflow. You will work daily with our data governance and AI governance consultants and with the legal and sovereignty specialists, and you will learn the regulatory side from them. The Databricks depth you bring with you.## **Your tasks*** Design and implement Unity Catalog for clients: metastore and catalog structure, workspace binding, external locations and storage credentials, identity federation (SCIM, service principals), ownership model.* Build access control that reflects the governance design: privileges and groups, row filters and column masks, attribute-based access control with tags, data classification; test it and document it so that auditors can read it.* Produce governance evidence from the platform: lineage, audit logs and billing from system tables, access reviews, dashboards for data owners and compliance teams; integrate with enterprise catalogs (Microsoft Purview, Collibra) where the client has them.* Implement data quality in pipelines: expectations in Lakeflow pipelines, Lakehouse Monitoring, quality metrics published to the catalog and to the governance team.* Govern AI assets on the platform with the AI governance team: models and functions registered in Unity Catalog, MLflow approval workflows, AI Gateway policies for LLM endpoints, logging for traceability.* Implement sovereignty and residency controls with the sovereignty team: region placement, customer-managed keys, private connectivity, Delta Sharing and Lakehouse Federation configured so that data stays where it must.* Migrate clients from Hive metastore and legacy permission models to Unity Catalog, and clean up what governance cannot see.* Build reusable assets: Unity Catalog reference setups as code (Terraform, Databricks Asset Bundles), access policy patterns, evidence dashboards; contribute to the governance-by-design reference architecture.## **Your profile*** 5+ years of hands-on Databricks engineering in production, including at least two years designing and administering Unity Catalog at enterprise scale (several workspaces, many teams).* Deep knowledge of Unity Catalog: privilege model, row and column security, tags and attribute-based policies, system tables, lineage, Delta Sharing, Lakehouse Federation; migration from Hive metastore.* Strong Spark, SQL and Python; Delta Lake; Lakeflow pipelines and jobs; infrastructure as code with Terraform and Databricks Asset Bundles; CI/CD.* Working knowledge of cloud security on Azure or AWS as it applies to Databricks: identity, storage access, private networking, key management.* Databricks Certified Data Engineer Professional or Associate; Platform Administrator accreditation is a plus.* Interest in data governance and regulation; experience with a governance or catalog tool (Purview, Collibra) or with GDPR, EU AI Act or sector-regulated data is a plus.* Ability to explain an access model or a lineage graph to a non-technical data owner; fluent English.* Experience in financial services, energy, pharma or public sector is a plus.## **What You'll love about working here*** **Practical benefits:** yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.* **Access to over 70 training tracks** with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings.* **Cutting-Edge Technology:** Position yourself at the forefront of IT innovation, working with the latest technologies and platforms. Capgemini partners with top global enterprises, including 145 Fortune 500 companies.* **Enjoy hybrid working model** that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.## **Get to know us**Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube.## **About Capgemini**Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market-leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.Make it real | www.capgemini.com