Data Engineer — Databricks Lakehouse & Governance

Capgemini; New York (NY); On-site; USD 86,000 - 127,000; Full time

Job summary

Capgemini is seeking a data engineer in New York to design, build, and operate the full medallion stack on Databricks, from Bronze data landing to Gold serving layers. You will implement Delta Live Tables, Lakeflow pipelines, and schema governance, while ensuring data quality and compliant data handling across client environments.

You will own Unity Catalog governance, PII controls, and pipeline observability, collaborating with teams to meet stringent regulatory requirements and deliver

Qualifications

• 5-7 years of data engineering experience with 2+ years of production Databricks work
• Strong Python for transformation logic and orchestration
• Expert SQL and schema design for analytical and serving workloads
• GCP fluency: BigQuery, Cloud Storage, Cloud Run, IAM
• Hands-on experience with at least one clean room tech or privacy-preserving data exchange
• PII governance knowledge in regulated contexts (GLBA, Fair Lending, UDAAP)

Responsibilities

• Design, build, and operate the full medallion stack on Databricks (Bronze to Gold)
• Implement Delta Live Tables and Lakeflow pipelines for data ingestion
• Enforce schemas at Bronze boundary to surface controlled upstream changes
• Govern Unity Catalog: access control, lineage, tenant isolation
• Maintain data-quality, lineage checks, and reconciliation
• Own CI/CD, IaC, cost management, and pipeline observability in Databricks environment

Skills

5-7 years data engineering

2+ years Databricks

Python

SQL

GCP (BigQuery, Cloud Storage, CloudRun

IAM, Cloud security

PII governance

Education

Bachelor’s or higher in CS/Engineering

Tools

Databricks

Delta Lake

Unity Catalog

DLT/Lakeflow

BigQuery

Vertex AI/AI Functions

Job description

Capgemini is seeking a data engineer in New York to design, build, and operate the full medallion stack on Databricks, from Bronze data landing to Gold serving layers. You will implement Delta Live Tables, Lakeflow pipelines, and schema governance, while ensuring data quality and compliant data handling across client environments.

You will own Unity Catalog governance, PII controls, and pipeline observability, collaborating with teams to meet stringent regulatory requirements and deliver