Senior Azure Databricks Data Engineer: Lakehouse Expert

EXL Talent Acquisition Team; New York (NY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

EXL Talent Acquisition Team in the United States is seeking a Senior Azure Databricks Data Engineer to design, develop, and optimize scalable data platforms using the Databricks Lakehouse Platform, with a focus on Azure cloud technologies and big data processing for enterprise analytics.

The role requires 9-15 years IT experience, hands-on Databricks, Spark, Delta Lake, SQL and Python, plus cloud and DevOps proficiency to support AI initiatives.

Qualifications

• Bachelor's or Master's degree in CS/IT/Engineering or related field.
• 9-15 years of experience in Data Engineering and Data Warehousing.
• Minimum 5+ years of hands-on experience with Azure Data Engineering technologies.
• Minimum 4+ years of hands-on experience with Azure Databricks and Spark ecosystem.
• Strong understanding of data lake, lakehouse, and cloud-native architecture patterns.
• Experience in handling large-scale structured and unstructured datasets.

Responsibilities

• Design, develop, and maintain data pipelines using Databricks, Apache Spark, and cloud-native services.

Skills

Databricks Lakehouse Platform

Apache Spark / PySpark

Delta Lake

SQL

Python

Education

Bachelor's or Master's degree in CS/IT/Engineering or related field

Tools

Azure

Terraform

GitHub Actions

Azure DevOps

Job description

EXL Talent Acquisition Team in the United States is seeking a Senior Azure Databricks Data Engineer to design, develop, and optimize scalable data platforms using the Databricks Lakehouse Platform, with a focus on Azure cloud technologies and big data processing for enterprise analytics.

The role requires 9-15 years IT experience, hands-on Databricks, Spark, Delta Lake, SQL and Python, plus cloud and DevOps proficiency to support AI initiatives.