Azure Data Engineer

Persistent Systems; Pune District; On-site; INR 2,500,000 - 4,500,000; Full time

Benefits offered by this job

Competitive salary and benefits

Talent development culture with growth

Cutting-edge technologies

Employee engagement events & flexible

Annual health check-ups

Insurance coverage: group term life,个人

Job summary

Persistent Systems in Pune seeks a Senior Azure Data Engineer to join a skilled team building modern, scalable healthcare data platforms for analytics, reporting, and decision-making. You will work with product owners, architects, software engineers and business stakeholders to deliver cloud-native data solutions.

Required: 6–10 years in Azure/AWS data engineering, 5+ years with Databricks and Kafka, Spark and Airflow, Snowflake experience, and strong CI/CD/DevOps practices.

Qualifications

• 6–10 years in Azure or AWS cloud-based data engineering environments.
• 5+ years with Databricks and Kafka.
• 2–4 years with Spark data processing.

Responsibilities

• Collaborate with product owners, analysts, architects, and engineers to deliver Agile-aligned solutions.
• Design, develop, test, and maintain scalable data pipelines and data-intensive applications.
• Develop cloud-native data solutions using Azure or AWS platforms.
• Build and optimize data processing frameworks using Databricks, Kafka, Spark, and Airflow.
• Design and implement batch and real-time data processing solutions.
• Develop and support APIs, relational and non-relational databases.
• Build and maintain Data-as-a-Service capabilities and data platform services.
• Implement CI/CD, DevOps and automation practices for data platforms.
• Monitor, troubleshoot production issues with incident management tools.

Skills

Azure & AWS data eng

Databricks

Kafka

Spark

Airflow

Snowflake

RESTful APIs

CI/CD/DevOps

Monitoring & Observability

Data integration

Tools

Databricks

Kafka

Spark

Airflow

Snowflake

Job description

About Position:

As a Sr. Azure Data Engineer, you will have the opportunity to be part of a highly skilled team focused on building modern, scalable, and secure healthcare data platforms that improve business outcomes and healthcare experiences. You will work closely with product owners, architects, software engineers, and business stakeholders to develop cloud-native data solutions that support analytics, reporting, operational intelligence, and data-driven decision-making.

• Role: Azure Data Engineer
• Location: Pune
• Experience: 6 to 10 Years
• Job Type: Full Time Employment

What You'll Do:

• Collaborate with product owners, system analysts, architects, and software engineers to deliver solutions aligned with Agile roadmaps.
• Design, develop, test, and maintain scalable data pipelines and data-intensive applications.
• Develop cloud-native data solutions using Azure or AWS platforms.
• Build and optimize data processing frameworks using Databricks, Kafka, Spark, and Airflow.
• Design and implement batch and real-time data processing solutions.
• Develop and support APIs, relational databases, and non-relational data storage solutions.
• Build and maintain Data-as-a-Service (DaaS) capabilities and modern data platform services.
• Implement software engineering best practices including reliability engineering, fault-tolerant architectures, and test automation.
• Follow and continuously improve CI/CD and DevOps processes to enable faster and more reliable releases.
• Utilize configuration management, automation, deployment, and monitoring tools to support platform operations.
• Collaborate on quality strategies to ensure highly available, resilient, scalable, and secure data platforms.
• Monitor, troubleshoot, and resolve production issues using incident management processes and tools such as ServiceNow.
• Support healthcare data integration and analytics initiatives while ensuring data quality and compliance requirements.
• Participate in architecture reviews, code reviews, and technical design discussions.
• Work closely with business and technical teams to deliver innovative, data-driven solutions.

Expertise You'll Bring:

• 6 to 10 years of experience in Azure or AWS cloud-based data engineering environments.
• 5+ years of hands-on experience working with Databricks and Kafka.
• 2 to 4 years of experience developing data processing solutions using Spark.
• Strong experience with Airflow for workflow orchestration and pipeline scheduling.
• 2 to 3 years of experience working with Snowflake and modern cloud data platforms.
• Extensive experience building scalable ETL/ELT pipelines and enterprise data integration solutions.
• Strong knowledge of distributed data processing and big data architectures.
• Experience developing and supporting both relational and non-relational databases.
• Working knowledge of RESTful APIs and service-oriented architectures.
• Experience implementing CI/CD, DevOps, and automation practices for data platforms.
• Strong understanding of monitoring, observability, and incident management processes.
• Experience building highly available, scalable, and fault-tolerant data solutions.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.