Senior Databricks Data Engineer - Lead Data Platforms

Capgemini

Bridgewater Township (NJ)

Hybrid

USD 84,000 - 156,000

Full time

14 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Paid time off
Medical, dental, and vision coverage
Retirement savings plans (e.g., 401(k)

Job summary

Capgemini is seeking an experienced Senior Databricks Data Engineer to design, build, and lead enterprise data platform solutions using Databricks Lakehouse, Delta Lake, PySpark, SQL, and cloud platforms. You will mentor data engineers, collaborate with senior clients, and define end-to-end architectures that drive business value.

The role emphasizes data governance, production-grade pipelines, and scalable architectures across Bronze–Silver–Gold layers, with opportunities to shape data strategy

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 6+ years of experience in Data Engineering.
  • 4+ years of hands-on experience with Databricks, designing and delivering enterprise-scale data engineering solutions.
  • Proven experience architecting and deploying end-to-end data platforms using Databricks Medallion Architecture.
  • Expert-level proficiency in PySpark, Python, and SQL.
  • Strong experience implementing and managing Delta Lake in production environments.
  • Hands-on experience with two cloud platforms (Azure, AWS, or GCP).
  • Experience leading and mentoring teams and managing senior client stakeholders.

Responsibilities

  • Design, develop, and deploy scalable, high-performance data engineering solutions using the Databricks Lakehouse Platform.
  • Define and implement end-to-end data architectures including Bronze-Silver-Gold layers.
  • Lead teams of data engineers and developers through enterprise data modernization initiatives.
  • Develop and optimize complex data pipelines using PySpark, Python, and SQL.
  • Build and deploy Delta Lake solutions in production with data quality and performance in mind.
  • Implement data sharing and collaboration using Delta Sharing and Databricks Marketplace.
  • Design and manage data governance with Unity Catalog; extract, transform, and integrate large data volumes.
  • Collaborate with business stakeholders to gather requirements and communicate technical recommendations.
  • Leverage Databricks AI/BI, Genie, Apps, and Data Visualization to deliver insights.
  • Develop orchestration workflows with Apache Airflow; implement CI/CD and DevOps for data projects.

Skills

Databricks
PySpark
SQL
Delta Lake
Cloud platforms
Python
Leadership
Client-facing

Education

Bachelor's degree in CS/IS/Engineering

Tools

Databricks Lakehouse Platform
Apache Airflow
Delta Sharing

Job description

Capgemini is seeking an experienced Senior Databricks Data Engineer to design, build, and lead enterprise data platform solutions using Databricks Lakehouse, Delta Lake, PySpark, SQL, and cloud platforms. You will mentor data engineers, collaborate with senior clients, and define end-to-end architectures that drive business value.

The role emphasizes data governance, production-grade pipelines, and scalable architectures across Bronze–Silver–Gold layers, with opportunities to shape data strategy

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Platform Architect
Senior Databricks Platform Architect

Capgemini • Atlanta (GA)

On-site
USD 103,000 - 184,000
Paid time off (Vacation, Holidays, etc
Medical, dental, vision coverage
401(k) retirement savings plan
+2
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)

Capgemini • Atlanta (GA)

On-site
USD 89,000 - 166,000
Vacation: 12-25 days
Company paid holidays
Personal days
+5
Senior Databricks Data Engineer – Lakehouse Real-Time
Senior Databricks Data Engineer – Lakehouse Real-Time

Capgemini • New York (NY)

On-site
USD 89,000 - 166,000
Paid time off
Health benefits
401(k) plan
+1
Senior Databricks Lakehouse Engineer - Data Platform Lead
Senior Databricks Lakehouse Engineer - Data Platform Lead

ExlService Holdings, Inc. • New York (NY)

On-site
USD 170,000 - 230,000
Lead Databricks Data Engineer | Cloud Platform Leader
Lead Databricks Data Engineer | Cloud Platform Leader

Fa Ewjt Saasfaprod1 • New York (NY)

On-site
USD 140,000 - 170,000
Senior Data Platform Architect: Lakehouse & Databricks Lead
Senior Data Platform Architect: Lakehouse & Databricks Lead

Publicis Sapient • Houston (TX)

Hybrid
USD 166,000 - 220,000
Diversity & collaboration
Learning opportunities
Competitive compensation
+2
Senior Data Engineer: Databricks Lakehouse Leader
Senior Data Engineer: Databricks Lakehouse Leader

Tata Consultancy Services Limited • Irvine (CA)

On-site
USD 120,000 - 180,000
Senior Lakehouse Data Architect & Platform Leader
Senior Lakehouse Data Architect & Platform Leader

Publicis Sapient • Houston (TX)

On-site
USD 166,000 - 220,000
Health benefits
Competitive compensation
Flexible work options
+2
Senior Data Platform Engineer: Databricks Lakehouse Lead
Senior Data Platform Engineer: Databricks Lakehouse Lead

Buildertrend • United States

Hybrid
USD 130,000 - 160,000
Health packages
401(k) with matching
Paid time off
+3
Senior Data Platform Architect - Lakehouse & Databricks
Senior Data Platform Architect - Lakehouse & Databricks

Sapient Corporation • Houston (TX)

On-site
USD 166,000 - 220,000
Health benefits
Paid leave
Learning opportunities
+1