Azure Databricks Developer

Persistent Systems; Hyderabad; Hybrid; INR 3,000,000 - 6,000,000; Full time

Benefits offered by this job

Competitive salary and benefits

Growth opportunities and education

Flexible work hours

Technology exposure and innovation

Long Service awards

Job summary

Persistent Systems is seeking an experienced Azure Databricks Engineer to design, develop, and maintain scalable data engineering solutions on Microsoft Azure. You will build robust ETL/ELT pipelines using Azure Databricks, PySpark, and SQL, ingest data from multiple sources, and ensure data quality, performance, and governance for analytics and reporting.

The role requires 9–12 years of hands-on experience in data engineering, strong Azure expertise, and collaboration with stakeholders, data

Qualifications

• 9–12 years of hands-on data engineering experience.
• Strong background in Azure cloud data solutions.
• Proficient in designing scalable ETL/ELT pipelines.
• Experience with Azure Databricks and PySpark in enterprise settings.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Azure Databricks, PySpark, and SQL.
• Build and maintain robust data ingestion frameworks to integrate structured and unstructured data from diverse enterprise sources.
• Collaborate with business stakeholders, data architects, and cross-functional teams to translate requirements into reliable data solutions.
• Ensure data quality, performance, security, and governance through monitoring, validation, and optimization of data workflows.
• Support deployment, troubleshooting, and continuous improvement of cloud-based data engineering solutions on the Azure platform.

Skills

Azure Databricks

PySpark

SQL

ETL/ELT pipelines

Data quality & governance

CI/CD practices

Cloud data architecture

Big data performance tuning

Tools

Azure Data Factory

Azure Storage

Job description

We are looking for an experienced Azure Databricks Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The role involves building robust ETL/ELT pipelines using Azure Databricks, PySpark, and SQL, integrating data from multiple sources, and ensuring high data quality, performance, and reliability. You will collaborate closely with business stakeholders, data architects, and engineering teams to deliver efficient, secure, and enterprise-grade data solutions for analytics and reporting purposes.

• Experience: 9 to 12 years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and optimize scalable ETL/ELT data pipelines using Azure Databricks, PySpark, and SQL.
• Build and maintain robust data ingestion frameworks to integrate structured and unstructured data from diverse enterprise sources.
• Collaborate with business stakeholders, data architects, and cross-functional teams to translate requirements into reliable data solutions.
• Ensure data quality, performance, security, and governance through monitoring, validation, and optimization of data workflows.
• Support deployment, troubleshooting, and continuous improvement of cloud-based data engineering solutions on the Azure platform.

Expertise You'll Bring:

• Strong experience in Azure Databricks, PySpark, and SQL for large-scale data processing and analytics.
• Hands-on expertise in designing and implementing ETL/ELT pipelines and data integration solutions.
• Proficiency in Azure Data Factory (ADF), Azure Storage, and other Azure data services.
• Experience with data modeling, performance tuning, data quality, and optimization of big data workloads.
• Good understanding of cloud data architecture, CI/CD practices, and data governance principles.
• Strong problem-solving skills with the ability to collaborate effectively with business, analytics, and engineering teams.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com/careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”