Senior Data Engineer

EXL Talent Acquisition Team; Detroit (MI); On-site; USD 110,000 - 140,000; Full time

Job summary

EXL Talent Acquisition Team is seeking a data engineering professional to design, develop, and maintain scalable data pipelines on Databricks and the Microsoft Azure Data Platform to support BI and advanced analytics objectives.

The role includes leading the migration of legacy databases and on-premises data systems to a cloud-based lakehouse architecture using Delta Lake, covering data modeling, transformation logic, and post-migration data validation.

Qualifications

• Experience designing scalable data pipelines.
• Hands-on experience with Databricks and Azure Data Platform.
• Experience migrating on-prem data systems to cloud-based lakehouse with Delta Lake.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Databricks and Azure Data Platform.
• Lead the technical migration of legacy databases and on-premises data systems to a cloud-based lakehouse using Delta Lake, including data modeling and post-migration validation.

Skills

Databricks

Azure Data Platform

Delta Lake

Data pipelines

Data modeling

ETL

Post-migration data validation

Tools

Databricks

Delta Lake

Azure Data Platform

Job description

Role Summary

Design, develop, and maintain scalable data pipelines and data assets on Databricks and the Microsoft Azure Data Platform to support Business Intelligence and Advanced Analytics objectives.

• Lead the technical migration of legacy databases and on-premises data systems to a cloud-based lakehouse architecture using Delta Lake, including data modeling, transformation logic, and post-migration data validation.