Azure Databricks Lead: Scalable Data Pipelines & DevOps

Capgemini

Jersey City (NJ)

On-site

USD 103,330 - 128,656

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Paid time off
Medical, dental, and vision coverage
Retirement savings plans

Job summary

Capgemini is seeking an experienced Azure Databricks Engineer in Jersey City, NJ. The role involves designing and optimizing ETL pipelines using Azure services, collaborating with Data Architects to enhance enterprise analytics.

The ideal candidate must possess solid expertise in PySpark, Delta Lake, and Azure Data Factory, ensuring effective data processing and governance while working in a dynamic environment.

Qualifications

  • 5+ years of experience in data engineering or similar roles.
  • Proven experience with cloud-based data solutions and platforms.
  • Strong programming skills in PySpark and experience with Azure services.

Responsibilities

  • Design, develop, and optimize ETL/ELT pipelines using Azure Databricks.
  • Build scalable data ingestion workflows from various sources.
  • Implement transformation logic, data cleansing, enrichment, and validation.

Skills

Cloud-based data engineering
ETL development
Distributed data processing
PySpark
Delta Lake
Azure Data Factory
Data pipeline development
DevOps processes
Data governance

Education

Bachelor's degree in a relevant field

Tools

Azure Databricks
Azure Data Factory
Git
Azure DevOps

Job description

Capgemini is seeking an experienced Azure Databricks Engineer in Jersey City, NJ. The role involves designing and optimizing ETL pipelines using Azure services, collaborating with Data Architects to enhance enterprise analytics.

The ideal candidate must possess solid expertise in PySpark, Delta Lake, and Azure Data Factory, ensuring effective data processing and governance while working in a dynamic environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Lead - Data Pipelines & Delta Lake
Azure Databricks Lead - Data Pipelines & Delta Lake

Capgemini • Charlotte (NC)

Hybrid
USD 103,330 - 128,656
Paid time off (12-25 days)
Medical, dental, and vision coverage
Retirement savings plans (401(k))
Azure Databricks Data Engineer — Scalable Pipelines & AI
Azure Databricks Data Engineer — Scalable Pipelines & AI

Tata Consultancy Services Limited • Eden Prairie (MN)

On-site
USD 110,000 - 120,000
Discretionary incentive
Medical coverage
Dental & Vision
+5
Azure Databricks Architect – Data Pipelines
Azure Databricks Architect – Data Pipelines

DXC Luxoft • United States

Remote
USD 120,000 - 180,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Azure Databricks Data Engineer for Enterprise Pipelines
Azure Databricks Data Engineer for Enterprise Pipelines

HIGH BRIDGE CONSULTING LLC • New York (NY)

Hybrid
USD 120,000 - 170,000
Azure Databricks Engineer
Azure Databricks Engineer

IQuest Solutions Corporation • Newtown Square

On-site
USD 120,000 - 170,000
Databricks Data Engineer - Azure, CDC Pipelines, PySpark
Databricks Data Engineer - Azure, CDC Pipelines, PySpark

CloudBigD • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse

Valiant Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 170,000