Azure Data Engineer

Mployee.me; Mumbai; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Competitive salary

Growth opportunities

Cutting-edge technologies

Flexible work hours

Annual health check-ups

Insurance coverage

Job summary

Persistent is seeking an Azure Data Engineer in Mumbai to design, develop, and optimize data pipelines using Azure Databricks and PySpark. You will work with cross-functional teams to build scalable data platforms for critical healthcare initiatives, ensuring data quality and production reliability.

The role requires 4–8 years of experience, strong SQL skills, and experience with Delta Lake and lakehouse architectures. You will contribute to governance, monitoring, and DevOps-enabled deployments.

Qualifications

• 4–8 years of data engineering experience.
• Hands-on with Azure Databricks and PySpark.
• Experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms.
• Strong SQL and data analysis skills.
• Experience with Azure cloud services.
• Knowledge of Delta Lake and Lakehouse architectures.
• Troubleshooting production data issues.
• Experience with CI/CD and DevOps practices.
• Excellent communication and stakeholder management.
• Bachelor's degree in Engineering/CS/IT.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build ETL/ELT workflows for large-scale processing.
• Develop data solutions using Azure services.
• Investigate data quality issues and production incidents.
• Monitor and optimize Spark workloads for performance.
• Create and maintain SQL queries and data models.
• Collaborate with stakeholders to deliver robust data solutions.
• Provide L2/L3 support for data platforms.
• Implement data governance and monitoring practices.

Skills

Analytical skills

Problem solving

Communication skills

Stakeholder management

Education

Bachelor's degree in Engineering/CS/IT

Tools

Azure Databricks

PySpark

SQL

Delta Lake

Data Lake

Lakehouse

Apache Spark

CI/CD

DevOps

Job description

About Position:

As an Azure Data Engineer, you will be part of a high-performing team focused on building scalable and reliable data solutions that support critical business and healthcare initiatives. You will collaborate with cross-functional teams to design, develop, and optimize modern data platforms using Azure, Databricks, and PySpark. This role offers an opportunity to work on large-scale data processing, cloud-based architectures, and advanced analytics solutions that help drive better business outcomes.

• Role: Azure Data Engineer
• Location: Mumbai
• Experience: Between 4 to 8 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, enhance, and support complex ETL/ELT workflows for large-scale data processing.
• Develop high-performance data solutions leveraging Azure data services and cloud-native technologies.
• Investigate and resolve data quality issues, pipeline failures, and production incidents.
• Perform root cause analysis and troubleshooting for data processing and platform-related issues.
• Monitor, optimize, and tune Spark workloads to improve performance, scalability, and reliability.
• Create and maintain efficient SQL queries, data models, and transformation logic.
• Collaborate with business stakeholders, architects, and engineering teams to understand requirements and deliver robust data solutions.
• Support production deployments and provide L2/L3 support for critical data platforms.
• Implement data governance, monitoring, and operational best practices.
• Ensure adherence to coding standards, security policies, and data engineering best practices.
• Drive continuous improvements in data processing frameworks, automation, and platform stability.

Expertise You'll Bring:

• 4 to 8 years of experience in Data Engineering, Big Data, and Data Integration projects.
• Strong hands-on experience with Azure Databricks and PySpark.
• Solid experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms.
• Strong proficiency in SQL, data analysis, and database concepts.
• Hands-on experience with Azure cloud services and modern data architectures.
• Experience working with Apache Spark for distributed data processing and optimization.
• Strong understanding of Delta Lake, Data Lake, and Lakehouse architectures.
• Experience in troubleshooting production issues, data inconsistencies, and performance bottlenecks.
• Knowledge of data governance, data quality, and metadata management practices.
• Experience with CI/CD pipelines, DevOps practices, and deployment automation.
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and stakeholder management skills.
• Bachelor's degree in Engineering, Computer Science, Information Technology, or a related field.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.