Data Engineer

Apollo Hospitals; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Apollo Hospitals in Chennai seeks an experienced Data Engineer - L2 to design, implement and manage enterprise data architecture across the data lake, ensuring data quality and security for analytics and AI use cases.

You will optimize ETL/ELT pipelines, ingest data from diverse sources (EMR, HIS, billing, IoT), and collaborate with architects and scientists to enable BI and AI projects while enforcing governance with Purview and robust security controls.

Qualifications

• 5+ years in data engineering with hands-on ETL/ELT development.
• Strong skills in Azure Data Factory, Azure Databricks, Synapse, Microsoft Fabric.
• Strong SQL, Python and Spark (PySpark) skills.
• Working knowledge of data lake architectures (medallion), Delta Lake, Parquet.
• Exposure to CI/CD for data pipelines and Git-based workflows.
• Understanding of data governance, cataloguing and lineage (Purview preferred).
• Preferred exposure to healthcare data models, HL7/FHIR and clinical analytics.

Responsibilities

• Design, build and operate ETL/ELT pipelines feeding the enterprise data lake.
• Manage ingestion from EMR, HIS, billing, marketing, finance, IoT and partner systems into bronze/silver/gold layers.
• Own data pipeline SLA adherence, monitoring, alerting and incident resolution.
• Partner with Data Architect and Data Scientists to provision datasets for BI and AI use cases.
• Implement data quality, lineage, cataloguing and governance controls (Azure Purview).
• Build and maintain data security architecture — row-level and column-level security, masking, access controls.
• Support downstream analytics teams with performant, well-modelled data marts.
• Participate in change management and deployment for data pipeline releases.
• Drive automation and toil reduction in data operations.
• Contribute to documentation, runbooks and on-call coverage for data platforms.

Skills

5+ years in data engineering

Azure Data Factory

Azure Databricks

Synapse

Microsoft Fabric

SQL

Python

Spark / PySpark

Delta Lake

Parquet

CI/CD for data pipelines

Purview / data governance

HL7 / FHIR healthcare data

Tools

Azure Data Lake Gen2

Microsoft Fabric

Azure Purview

Job description

The Apollo Hospitals Family

Set-up in 1983 by Dr. Prathap C. Reddy, renowned as the architect of modern healthcare in India. As the nations first corporate hospital, Apollo Hospitals is acclaimed for pioneering the private healthcare revolution in the country.

Apollo Hospitals has emerged as Asia’s foremost integrated healthcare services provider and has a robust presence across the healthcare ecosystem, including Hospitals, Pharmacies, Primary Care & Diagnostic Clinics and several retail health models. The cornerstones of Apollo’s legacy are its unstinting focus on clinical excellence, affordable costs, modern technology and forward-looking research & academics.

Role Description

The Data Engineer - L2 designs, implements and manages Apollo's enterprise data architecture covering all software applications, integrations and data security. The role owns ETL/ELT pipelines, data quality, SLA adherence and incident resolution across the enterprise data lake (bronze/silver/gold layers), enabling data-driven decision-making for corporate and unit business reviews.

Detailed Job Responsibility & Accountabilities

• Design, build and operate ETL/ELT pipelines feeding the enterprise data lake (Azure Data Lake Gen2, Microsoft Fabric).
• Manage ingestion from EMR, HIS, billing, marketing, finance, IoT and partner systems into bronze/silver/gold layers.
• Own data pipeline SLA adherence, monitoring, alerting and incident resolution.
• Partner with Data Architect and Data Scientists to provision datasets for BI and AI use cases.
• Implement data quality, lineage, cataloguing and governance controls (Azure Purview).
• Build and maintain data security architecture — row-level and column-level security, masking, access controls.
• Support downstream analytics teams with performant, well-modelled data marts.
• Participate in change management and deployment for data pipeline releases.
• Drive automation and toil reduction in data operations.
• Contribute to documentation, runbooks and on-call coverage for data platforms.

Desired Skills & Competencies

• Must have 5+ years in data engineering with hands-on ETL/ELT development.
• Must have strong skills in Azure Data Factory, Azure Databricks, Synapse, Microsoft Fabric.
• Must have strong SQL, Python and Spark (PySpark) skills.
• Must have working knowledge of data lake architectures (medallion), Delta Lake, Parquet.
• Must have exposure to CI/CD for data pipelines and Git-based workflows.
• Must have understanding of data governance, cataloguing and lineage (Purview preferred).
• Preferred exposure to healthcare data models, HL7/FHIR and clinical analytics.

Job Performance Parameters

• On-time delivery of data pipelines (target 20%)
• Pipeline success rate (target 25%)
• SLA adherence (target 20%)
• Incident SLA adherence (target 20%)
• Change quality (target 15%)
• Data quality metrics for downstream consumers

Managerial and Behavioral Competencies

• Attention to detail
• Analytical and problem-solving rigour
• Team Spirit
• Effective Communication
• Ownership and follow-through

Reporting (Functional & Administrative)

Head - DataLake Operations Management

Preferred Language / Industry / Location / Desired Work Experience

English, Hindi, Odia / Healthcare + IT / Corporate IT / 5+ years

Grade / Designation, Department

Grade 11 / Data Engineer - L2, Information Technology - Preferred candidates with cloud data platform experience and production pipeline operations exposure