Senior Azure Databricks Engineer — Remote

Exavalu; United States; Hybrid; USD 140,000 - 180,000; Full time

Job summary

Exavalu is hiring a Senior Azure Databricks Engineer to design, develop, and scale data platforms on Microsoft Azure. You will build robust ETL/ELT pipelines with PySpark, Delta Lake, and Databricks, collaborating with stakeholders to deliver enterprise-grade data solutions.

The role requires 5–10 years of experience, strong Python/SQL skills, and a focus on performance, governance, and CI/CD practices. This hybrid position supports collaboration across locations and remote work options.

Qualifications

• Strong hands-on experience with Azure Databricks and PySpark.
• Expertise in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure SQL.
• Strong programming skills in Python and SQL.
• Experience designing and implementing Lakehouse and Data Warehouse solutions.
• Hands-on experience with Delta Lake, Spark optimization, partitioning, and performance tuning.
• Knowledge of CI/CD pipelines, Azure DevOps, Git, and deployment best practices.
• Experience handling large-scale structured and unstructured datasets.
• Strong analytical, troubleshooting, and communication skills.

Responsibilities

• Design, develop, and maintain scalable data platforms and pipelines on Microsoft Azure.
• Build robust ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory.
• Develop and optimize Lakehouse architectures leveraging Delta Lake and Databricks best practices.
• Work closely with business stakeholders, architects, and analytics teams to deliver enterprise-grade data solutions.
• Implement data quality, governance, monitoring, and performance optimization strategies.
• Participate in solution design, code reviews, deployment activities, and technical mentoring.
• Support real-time and batch data processing use cases across large-scale data environments.

Skills

Azure Databricks

PySpark

Python

SQL

Azure Data Factory

Delta Lake

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Spark optimization

CI/CD pipelines

Azure DevOps

Git

Tools

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS Gen2)

Azure Synapse Analytics

Azure SQL

Delta Lake

Databricks

Git

Azure DevOps

Job description

Exavalu is hiring a Senior Azure Databricks Engineer to design, develop, and scale data platforms on Microsoft Azure. You will build robust ETL/ELT pipelines with PySpark, Delta Lake, and Databricks, collaborating with stakeholders to deliver enterprise-grade data solutions.

The role requires 5–10 years of experience, strong Python/SQL skills, and a focus on performance, governance, and CI/CD practices. This hybrid position supports collaboration across locations and remote work options.