Azure Data Engineer

Persistent Systems; Pune District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Persistent Systems in Pune is seeking a Sr. Azure Data Engineer to join a highly skilled team focused on building modern, scalable healthcare data platforms that improve business outcomes and healthcare experiences.

You will work closely with product owners, architects, software engineers, and business stakeholders to develop cloud-native data solutions that support analytics, reporting, operational intelligence, and data-driven decision-making.

Qualifications

• 6–10 years of experience in Azure or AWS cloud-based data engineering environments.
• 5+ years of hands-on Databricks and Kafka experience.
• 2–4 years of Spark development for data processing.
• Strong Airflow workflow orchestration experience.
• 2–3 years with Snowflake and modern cloud data platforms.
• Extensive experience building ETL/ELT pipelines and data integration.
• Knowledge of RESTful APIs and service-oriented architectures.
• CI/CD, DevOps, and automation for data platforms.
• Monitoring, observability, and incident management practices.

Responsibilities

• Collaborate with product owners, analysts, architects, and engineers to deliver solutions aligned with Agile roadmaps.
• Design, develop, test, and maintain scalable data pipelines and data-intensive applications.
• Develop cloud-native data solutions on Azure or AWS platforms.
• Build and optimize data processing frameworks using Databricks, Kafka, Spark, and Airflow.
• Design batch and real-time data processing solutions.
• Develop and support APIs, relational and non-relational databases.
• Build and maintain Data-as-a-Service (DaaS) capabilities and modern data platform services.
• Implement reliability, fault-tolerant architectures, and test automation.
• Follow CI/CD and DevOps processes for faster, reliable releases.
• Utilize tooling for deployment, monitoring, and platform operations.
• Contribute to quality strategies for highly available, scalable, and secure data platforms.
• Monitor, troubleshoot, and resolve production issues using incident management processes.
• Support healthcare data integration and analytics with data quality and compliance.
• Participate in architecture and code reviews and design discussions.
• Collaborate with business and technical teams to deliver innovative, data-driven solutions.

Tools

Databricks

Kafka

Spark

Airflow

Snowflake

Job description

As a Sr. Azure Data Engineer, you will have the opportunity to be part of a highly skilled team focused on building modern, scalable, and secure healthcare data platforms that improve business outcomes and healthcare experiences. You will work closely with product owners, architects, software engineers, and business stakeholders to develop cloud-native data solutions that support analytics, reporting, operational intelligence, and data-driven decision-making.

• Location: Pune
• Experience: 6 to 10 Years
• Job Type: Full Time Employment

What You'll Do:

• Collaborate with product owners, system analysts, architects, and software engineers to deliver solutions aligned with Agile roadmaps.
• Design, develop, test, and maintain scalable data pipelines and data-intensive applications.
• Develop cloud-native data solutions using Azure or AWS platforms.
• Build and optimize data processing frameworks using Databricks, Kafka, Spark, and Airflow.
• Design and implement batch and real-time data processing solutions.
• Develop and support APIs, relational databases, and non-relational data storage solutions.
• Build and maintain Data-as-a-Service (DaaS) capabilities and modern data platform services.
• Implement software engineering best practices including reliability engineering, fault-tolerant architectures, and test automation.
• Follow and continuously improve CI/CD and DevOps processes to enable faster and more reliable releases.
• Utilize configuration management, automation, deployment, and monitoring tools to support platform operations.
• Collaborate on quality strategies to ensure highly available, resilient, scalable, and secure data platforms.
• Monitor, troubleshoot, and resolve production issues using incident management processes and tools such as ServiceNow.
• Support healthcare data integration and analytics initiatives while ensuring data quality and compliance requirements.
• Participate in architecture reviews, code reviews, and technical design discussions.
• Work closely with business and technical teams to deliver innovative, data-driven solutions.

Expertise You'll Bring:

• 6 to 10 years of experience in Azure or AWS cloud-based data engineering environments.
• 5+ years of hands-on experience working with Databricks and Kafka.
• 2 to 4 years of experience developing data processing solutions using Spark.
• Strong experience with Airflow for workflow orchestration and pipeline scheduling.
• 2 to 3 years of experience working with Snowflake and modern cloud data platforms.
• Extensive experience building scalable ETL/ELT pipelines and enterprise data integration solutions.
• Strong knowledge of distributed data processing and big data architectures.
• Experience developing and supporting both relational and non-relational databases.
• Working knowledge of RESTful APIs and service-oriented architectures.
• Experience implementing CI/CD, DevOps, and automation practices for data platforms.
• Strong understanding of monitoring, observability, and incident management processes.Experience building highly available, scalable, and fault-tolerant data solutions.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.