Senior Azure Databrick Engineer

Exavalu; United States; Hybrid; USD 140,000 - 180,000; Full time

Job summary

Exavalu is hiring a Senior Azure Databricks Engineer to design, develop, and scale data platforms on Microsoft Azure. You will build robust ETL/ELT pipelines with PySpark, Delta Lake, and Databricks, collaborating with stakeholders to deliver enterprise-grade data solutions.

The role requires 5–10 years of experience, strong Python/SQL skills, and a focus on performance, governance, and CI/CD practices. This hybrid position supports collaboration across locations and remote work options.

Qualifications

• Strong hands-on experience with Azure Databricks and PySpark.
• Expertise in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure SQL.
• Strong programming skills in Python and SQL.
• Experience designing and implementing Lakehouse and Data Warehouse solutions.
• Hands-on experience with Delta Lake, Spark optimization, partitioning, and performance tuning.
• Knowledge of CI/CD pipelines, Azure DevOps, Git, and deployment best practices.
• Experience handling large-scale structured and unstructured datasets.
• Strong analytical, troubleshooting, and communication skills.

Responsibilities

• Design, develop, and maintain scalable data platforms and pipelines on Microsoft Azure.
• Build robust ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory.
• Develop and optimize Lakehouse architectures leveraging Delta Lake and Databricks best practices.
• Work closely with business stakeholders, architects, and analytics teams to deliver enterprise-grade data solutions.
• Implement data quality, governance, monitoring, and performance optimization strategies.
• Participate in solution design, code reviews, deployment activities, and technical mentoring.
• Support real-time and batch data processing use cases across large-scale data environments.

Skills

Azure Databricks

PySpark

Python

SQL

Azure Data Factory

Delta Lake

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Spark optimization

CI/CD pipelines

Azure DevOps

Git

Tools

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS Gen2)

Azure Synapse Analytics

Azure SQL

Delta Lake

Databricks

Git

Azure DevOps

Job description

WE ARE HIRING | Databricks Engineer | 5+ Years | Remote | Exavalu

Build. Transform. Scale. With Databricks.

About Exavalu

Exavalu is a global technology consulting and digital transformation organization specializing in Cloud, Data & Analytics, AI, Digital Engineering, and Enterprise Solutions. We partner with leading organizations across industries to deliver innovative, scalable, and business-driven technology solutions. With a strong focus on customer success and innovation, Exavalu offers professionals the opportunity to work on cutting-edge global projects and emerging technologies.

Website: https://www.exavalu.com LinkedIn: https://www.linkedin.com/company/exavalu/

Position: Senior Azure Databricks Engineer

Number of Position: 3

Experience: 5 -10 Years

Employment Type: Full-Time

Notice Period: Can join within 15-30 days

Location: Hybrid (For Kolkata | Chennai | Hyderabad )

Remote (other location)

Interview Process: Technical L1 (Online) -> Leadership Round (Face to face Mandatory) --> Client Round (if required) --> HR Discussion (Final)

Role & Responsibilities

• Design, develop, and maintain scalable data platforms and pipelines on Microsoft Azure.
• Build robust ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory.
• Develop and optimize Lakehouse architectures leveraging Delta Lake and Databricks best practices.
• Work closely with business stakeholders, architects, and analytics teams to deliver enterprise-grade data solutions.
• Implement data quality, governance, monitoring, and performance optimization strategies.
• Participate in solution design, code reviews, deployment activities, and technical mentoring.
• Support real-time and batch data processing use cases across large-scale data environments.

Required Skills

• Strong hands-on experience with Azure Databricks and PySpark.
• Expertise in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure SQL.
• Strong programming skills in Python and SQL.
• Experience designing and implementing Lakehouse and Data Warehouse solutions.
• Hands-on experience with Delta Lake, Spark optimization, partitioning, and performance tuning.
• Knowledge of CI/CD pipelines, Azure DevOps, Git, and deployment best practices.
• Experience handling large-scale structured and unstructured datasets.
• Strong analytical, troubleshooting, and communication skills.

Preferred Qualifications

• Microsoft Azure Certification(s) preferred.
• Experience working in Agile/Scrum environments.
• Exposure to data governance, security, and modern analytics platforms.
• Experience leading technical discussions and mentoring junior team members.