Databricks Architect: Lakehouse, MLOps on Azure

Capgemini

New York (NY)

On-site

USD 136,000 - 150,000

Full time

46 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Capgemini is seeking a data engineering lead to design scalable Lakehouse architectures using Delta Lake and Unity Catalog, and to manage data infrastructure on major cloud platforms. You will implement ETL/ELT workflows, leverage Delta Live Tables, and orchestrate complex data processes with Databricks.

You will drive data security and governance, optimize Spark workloads, and collaborate with DevOps teams to apply Terraform-based deployment practices for enterprise Azure Databricks

Qualifications

  • Hands-on experience designing scalable data architectures (Lakehouse) with Delta Lake and Unity Catalog.
  • Experience with Databricks ecosystem including Delta Live Tables and Workflows.
  • Experience architecting ML platforms, advanced analytics workloads and MLOps on Databricks.
  • Leading enterprise Azure Databricks implementations and working with DevOps teams using Terraform or similar.

Responsibilities

  • Contribute to the design and implementation of scalable data architectures (Lakehouse) using Delta Lake and Unity Catalog.
  • Manage and maintain data infrastructure on cloud platforms (AWS, Azure, or GCP).
  • Design and build robust ETL/ELT workflows and orchestrate data processes with Databricks.
  • Implement data security, governance, and cost governance policies; optimize Spark jobs for large datasets.

Skills

Data engineering
Delta Lake
Databricks
Kafka
Terraform
CI/CD
Spark tuning

Tools

Delta Lake
Unity Catalog
Databricks
Delta Live Tables
Databricks Workflows
Kafka
Event Hubs
Kinesis
Azure
Terraform

Job description

Capgemini is seeking a data engineering lead to design scalable Lakehouse architectures using Delta Lake and Unity Catalog, and to manage data infrastructure on major cloud platforms. You will implement ETL/ELT workflows, leverage Delta Live Tables, and orchestrate complex data processes with Databricks.

You will drive data security and governance, optimize Spark workloads, and collaborate with DevOps teams to apply Terraform-based deployment practices for enterprise Azure Databricks

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Databricks Lakehouse Architect
Senior Azure Databricks Lakehouse Architect

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Remote Databricks Lakehouse Architect Lead
Remote Databricks Lakehouse Architect Lead

NewVision Software • United States

Remote
USD 120,000 - 180,000
Lead Databricks Engineer
Lead Databricks Engineer

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000
Azure Databricks Data Architect - Lead Lakehouse Solutions
Azure Databricks Data Architect - Lead Lakehouse Solutions

Ascendum Solutions • Cincinnati (OH)

On-site
USD 140,000 - 170,000
Lead Databricks Lakehouse Architect (Remote)
Lead Databricks Lakehouse Architect (Remote)

Celebal Technologies • United States

Remote
USD 140,000 - 210,000
Career development
Cutting-edge Databricks tech exposure
Global collaboration
Cloud Data Engineer - Lakehouse & Delta Lake Lead
Cloud Data Engineer - Lakehouse & Delta Lake Lead

ExlService Holdings, Inc. • Detroit (MI)

On-site
USD 110,000 - 140,000
Databricks Data Engineer: Lakehouse & Spark Architect
Databricks Data Engineer: Lakehouse & Spark Architect

CloudBigD • Atlanta (GA)

On-site
USD 86,000 - 123,000
Databricks Platform Architect - Azure Lakehouse Governance
Databricks Platform Architect - Azure Lakehouse Governance

BlueFlag LLC • Dallas (TX)

On-site
USD 140,000 - 210,000
Competitive salary
Generous annual leave
Comprehensive health plan
+2
Databricks Lakehouse Architect — Enterprise Data Platform Lead
Databricks Lakehouse Architect — Enterprise Data Platform Lead

CloudBigD • Austin (TX)

On-site
USD 100,000 - 142,000
Databricks Lakehouse Architect (Governance & Security)
Databricks Lakehouse Architect (Governance & Security)

Capgemini • United States

Remote
USD 82,000 - 128,000
Medical benefits
Dental benefits
Vision benefits
+1