Azure Databricks Developer

Persistent; Hyderabad, Bengaluru; Hybrid; INR 2,500,000 - 5,500,000; Full time

Benefits offered by this job

Competitive salary

Education sponsorship

Cutting-edge technologies

Long Service awards

Annual health check-ups

Insurance coverage

Job summary

Persistent is seeking an experienced Azure Databricks Engineer to design, develop, and maintain scalable data pipelines on the Azure cloud platform for analytics and reporting purposes.

The role requires 9–12 years of experience, focusing on Azure Databricks, PySpark, and SQL, with exposure to Azure Data Factory and storage services. Hybrid work is supported, with locations in Hyderabad or Bangalore.

Qualifications

• 9–12 years of experience in data engineering on Azure.
• Proficient with Azure Databricks, PySpark and SQL.
• Experience with Azure Data Factory and storage services.
• Strong understanding of data governance, quality, and performance.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines on Azure Databricks.
• Build robust data ingestion frameworks from diverse sources.
• Collaborate with stakeholders and engineering teams to translate requirements into data solutions.
• Ensure data quality, security, and governance across workflows.
• Support deployment, troubleshooting, and continuous improvement on Azure.

Skills

Azure Databricks

PySpark

SQL

ADF

CI/CD

Tools

Azure Data Factory

Azure Storage

Job description

About Position:

We are looking for an experienced Azure Databricks Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The role involves building robust ETL/ELT pipelines using Azure Databricks, PySpark, and SQL, integrating data from multiple sources, and ensuring high data quality, performance, and reliability. You will collaborate closely with business stakeholders, data architects, and engineering teams to deliver efficient, secure, and enterprise-grade data solutions for analytics and reporting purposes.

• Role: Azure Databricks developer
• Location: Hyderabad & Bangalore
• Experience: 9 to 12 years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and optimize scalable ETL/ELT data pipelines using Azure Databricks, PySpark, and SQL.
• Build and maintain robust data ingestion frameworks to integrate structured and unstructured data from diverse enterprise sources.
• Collaborate with business stakeholders, data architects, and cross-functional teams to translate requirements into reliable data solutions.
• Ensure data quality, performance, security, and governance through monitoring, validation, and optimization of data workflows.
• Support deployment, troubleshooting, and continuous improvement of cloud-based data engineering solutions on the Azure platform.

Expertise You'll Bring:

• Strong experience in Azure Databricks, PySpark, and SQL for large-scale data processing and analytics.
• Hands-on expertise in designing and implementing ETL/ELT pipelines and data integration solutions.
• Proficiency in Azure Data Factory (ADF), Azure Storage, and other Azure data services.
• Experience with data modeling, performance tuning, data quality, and optimization of big data workloads.
• Good understanding of cloud data architecture, CI/CD practices, and data governance principles.
• Strong problem-solving skills with the ability to collaborate effectively with business, analytics, and engineering teams.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."