Azure Data Engineer

Persistent Systems; Mumbai; Hybrid; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Talent development

Education sponsorship

Flexible hours

Long service awards

Project parties

Job summary

Persistent Systems in Mumbai, India, is seeking an Azure Data Engineer to join a high-performing team focused on scalable data platforms. You will design, develop, and optimize data pipelines using Azure Databricks, PySpark, and Delta Lake to support healthcare and business initiatives.

The role requires 4–8 years of experience, full-time employment, and collaboration with cross-functional teams to deliver robust data solutions.

Qualifications

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data solutions leveraging Azure data services and cloud-native technologies.
• Troubleshoot data quality issues and production incidents.
• Monitor Spark workloads and optimize performance.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build, enhance, and support ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services.
• Investigate and resolve data quality issues and production incidents.
• Monitor, optimize, and tune Spark workloads for performance.

Skills

SQL

Data modeling

Data governance

CI/CD

DevOps practices

Stakeholder communication

Education

Bachelor's degree in Engineering/CS/IT or related field

Tools

Azure Databricks

PySpark

Delta Lake

Spark

Job description

As an Azure Data Engineer, you will be part of a high-performing team focused on building scalable and reliable data solutions that support critical business and healthcare initiatives. You will collaborate with cross-functional teams to design, develop, and optimize modern data platforms using Azure, Databricks, and PySpark. This role offers an opportunity to work on large-scale data processing, cloud-based architectures, and advanced analytics solutions that help drive better business outcomes.

• Experience: Between 4 to 8 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, enhance, and support complex ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services and cloud-native technologies.
• Investigate and resolve data quality issues, pipeline failures, and production incidents.
• Perform root cause analysis and troubleshooting for data processing and platform-related issues.
• Monitor, optimize, and tune Spark workloads to improve performance, scalability, and reliability.
• Create and maintain efficient SQL queries, data models, and transformation logic.
• Collaborate with business stakeholders, architects, and engineering teams to understand requirements and deliver robust data solutions.
• Support production deployments and provide L2/L3 support for critical data platforms.
• Implement data governance, monitoring, and operational best practices.
• Ensure adherence to coding standards, security policies, and data engineering best practices.
• Drive continuous improvements in data processing frameworks, automation, and platform stability.

Expertise You'll Bring:

• 4 to 8 years of experience in Data Engineering, Big Data, and Data Integration projects.
• Strong hands-on experience with Azure Databricks and PySpark.
• Solid experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms.
• Strong proficiency in SQL, data analysis, and database concepts.
• Hands-on experience with Azure cloud services and modern data architectures.
• Experience working with Apache Spark for distributed data processing and optimization.
• Strong understanding of Delta Lake, Data Lake, and Lakehouse architectures.
• Experience in troubleshooting production issues, data inconsistencies, and performance bottlenecks.
• Knowledge of data governance, data quality, and metadata management practices.
• Experience with CI/CD pipelines, DevOps practices, and deployment automation.
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and stakeholder management skills.
• Bachelor's degree in Engineering, Computer Science, Information Technology, or a related field.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."