Azure Data Engineer

Persistent Systems; Telangana; On-site; INR 1,100,000 - 1,800,000; Full time

Job summary

Persistent Systems is seeking an Azure Data Engineer to join a high-performing data team. You will design, develop, and optimize scalable data platforms using Azure Databricks and PySpark to support critical business initiatives.

You will collaborate with cross-functional teams across India to deliver reliable, cloud-native data solutions, uplift data governance, and ensure production-grade ETL/ELT pipelines in enterprise environments.

Qualifications

• 4–8 years of experience in Data Engineering and data integration.
• Strong hands-on expertise with Azure Databricks and PySpark.
• Proficiency in SQL, data analysis, and data modeling for enterprise platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Azure Databricks and PySpark.
• Build ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions using Azure data services.
• Investigate data quality issues and production incidents.
• Monitor and tune Spark workloads for performance and reliability.
• Collaborate with stakeholders to deliver robust data solutions.

Skills

ETL/ELT design

SQL & data analysis

Data modeling

Tools

Azure Databricks

PySpark

Apache Spark

Delta Lake

Data Lake

Job description

About Persistent

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 18 of the Fortune 50 companies, 7 of the 10 top US banks, 9 of the 10 technology companies, and numerous innovators across the healthcare ecosystem.

Our disruptor's mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum. Persistent has been recognized across top industry platforms for innovation, leadership, and inclusion. We have delivered 26 sequential quarters of growth with $487.6M in Q4 FY26 revenue, up 7.8% Q-o-Q and 20.0% Y-o-Y. Our 29,500+ global team members, located in 21 countries, have been instrumental in helping the market leaders transform their industries. We received five awards at the ISG (Information Services Group) Provider Lens Awards 2026 and, for the second year in a row, were awarded the Growth Honor of the Year at the Everest Group Elevate 2026.

About Position

As an Azure Data Engineer, you will be part of a high-performing team focused on building scalable and reliable data solutions that support critical business and healthcare initiatives. You will collaborate with cross-functional teams to design, develop, and optimize modern data platforms using Azure, Databricks, and PySpark. This role offers an opportunity to work on large-scale data processing, cloud-based architectures, and advanced analytics solutions that help drive better business outcomes.

• Role: Azure Data Engineer
• Location: Mumbai, Hyderabad, Bengaluru
• Experience: Between 4 to 8 Years
• Job Type: Full Time Employment

What You'll Do

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, enhance, and support complex ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services and cloud-native technologies.
• Investigate and resolve data quality issues, pipeline failures, and production incidents.
• Perform root cause analysis and troubleshooting for data processing and platform-related issues.
• Monitor, optimize, and tune Spark workloads to improve performance, scalability, and reliability.
• Create and maintain efficient SQL queries, data models, and transformation logic.
• Collaborate with business stakeholders, architects, and engineering teams to understand requirements and deliver robust data solutions.
• Support production deployments and provide L2/L3 support for critical data platforms.
• Implement data governance, monitoring, and operational best practices.
• Ensure adherence to coding standards, security policies, and data engineering best practices.
• Drive continuous improvements in data processing frameworks, automation, and platform stability.

Expertise You'll Bring

• 4-8 years of experience in Data Engineering, Big Data, and Data Integration projects.
• Strong hands-on experience with Azure Databricks and PySpark.
• Solid experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms.
• Strong proficiency in SQL, data analysis, and database concepts.
• Hands-on experience with Azure cloud services and modern data architectures.
• Experience working with Apache Spark for distributed data processing and optimization.
• Strong understanding of Delta Lake, Data Lake, and Lakehouse architectures.
• Experience in troubleshooting production issues, data inconsistencies, and performance bottlenecks.
• Knowledge of data governance, data quality, and metadata management practices.
• Experience with CI/CD…