Azure Data Engineer

Persistent Systems; Mumbai; Hybrid; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Higher education sponsorship

Flexible work hours

Long Service awards

Insurance coverage

Job summary

Persistent Systems Limited is seeking an Azure Data Engineer to join a high-performing team focused on building scalable data solutions using Azure Databricks and PySpark. You will design, develop, and maintain data pipelines, ETL/ELT workflows, and data models to enable large-scale analytics for healthcare initiatives.

You will collaborate with cross-functional teams, resolve data quality issues, and optimize Spark workloads, while adhering to governance and security standards.

Qualifications

• 4–8 years of experience in Data Engineering

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, enhance, and support complex ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services.
• Investigate and resolve data quality issues, pipeline failures, and production incidents.
• Monitor, optimize, and tune Spark workloads for performance and reliability.
• Create and maintain efficient SQL queries, data models, and transformation logic.
• Collaborate with stakeholders to understand requirements and deliver robust data solutions.
• Provide L2/L3 support for critical data platforms and deployments.
• Implement data governance, monitoring, and operational best practices.

Skills

Azure Databricks

PySpark

SQL

Delta Lake

ETL/ELT pipelines

Azure Cloud

Spark tuning

Data modeling

Education

Bachelor's degree in Engineering/Computer Science/IT

Job description

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 18 of the Fortune 50 companies, 7 of the 10 top US banks, 9 of the 10 technology companies, and numerous innovators across the healthcare ecosystem.

Our disruptor's mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We have delivered 26sequential quarters of growth with $487.6M in Q4 FY26 revenue, up 7.8% Q-o-Q and 20.0% Y-o-Y. Our 29,500+global team members, located in 21 countries, have been instrumental in helping the market leaders transform their industries. We received five awards at the ISG (Information Services Group) Provider Lens Awards 2026 and, for the second year in a row, were awarded the Growth Honor of the Year at the Everest Group Elevate 2026.

AboutPosition:

As an Azure Data Engineer, you will be part of a high-performing team focused on building scalable and reliable data solutions that support critical business and healthcare initiatives. You will collaborate with cross-functional teams to design, develop, and optimize modern data platforms using Azure, Databricks, and PySpark. This role offers an opportunity to work on large-scale data processing, cloud-based architectures, and advanced analytics solutions that help drive better business outcomes.

• Experience: Between 4 to 8 Years
• Job Type: Full Time Employment

WhatYou'llDo:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, enhance, and support complex ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services and cloud-native technologies.
• Investigate and resolve data quality issues, pipeline failures, and production incidents.
• Perform root cause analysis and troubleshooting for data processing and platform-related issues.
• Monitor, optimize, and tune Spark workloads to improve performance, scalability, and reliability.
• Create and maintain efficient SQL queries, data models, and transformation logic.
• Collaborate with business stakeholders, architects, and engineering teams to understand requirements and deliver robust data solutions.
• Support production deployments and provide L2/L3 support for critical data platforms.
• Implement data governance, monitoring, and operational best practices.
• Ensure adherence to coding standards, security policies, and data engineering best practices.
• Drive continuous improvements in data processing frameworks, automation, and platform stability.

ExpertiseYou'llBring:

• 4-8 years of experience in Data Engineering, Big Data, and Data Integration projects.
• Strong hands‑on experience with Azure Databricks and PySpark.
• Solid experience designing and developing ETL/ELT pipelines for enterprise‑scale data platforms.
• Strong proficiency in SQL, data analysis, and database concepts.
• Hands‑on experience with Azure cloud services and modern data architectures.
• Experience working with Apache Spark for distributed data processing and optimization.
• Strong understanding of Delta Lake, Data Lake, and Lakehouse architectures.
• Experience in troubleshooting production issues, data inconsistencies, and performance bottlenecks.
• Knowledge of data governance, data quality, and metadata management practices.
• Experience with CI/CD pipelines, DevOps practices, and deployment automation.
• Strong analytical, problem‑solving, and debugging skills.
• Excellent communication and stakeholder management skills.
• Bachelor's degree in Engineering, Computer Science, Information Technology, or a related field.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility‑friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."