Senior Data Engineer

Narayana Health (NH); Bengaluru; On-site; INR 900,000 - 1,600,000; Full time

Job summary

Narayana Health, headquartered in Bengaluru, invites a Data Engineer to join Medha Analytics powering healthcare insights. The role focuses on building and maintaining a modern data platform, data pipelines, and dashboards to support reporting and decision making.

You will collaborate with Product, Data, and Design teams, leverage Azure/AWS/GCP, Spark, Python/Scala/Java, and optimize data delivery. The ideal candidate combines strong coding skills with cloud and big data experience and excellent

Qualifications

• Education: B.E. or B.Tech in a relevant field.
• 3 to 6 years of experience as a Data Engineer.
• Experience with AWS/Azure/GCP public clouds.
• Proficient in Python/Scala/Java and Spark/Hadoop (HDFS).
• Strong SQL skills and data modeling.
• Experience with RESTful services and DevOps tools (Docker/Kubernetes/Git).

Responsibilities

• Design and maintain data pipelines and modern data platforms.
• Build scalable ETL/ELT processes and data extraction.
• Collaborate with Product/Data/Design teams to solve data needs.
• Optimize data delivery and infrastructure for scale.
• Work with Azure/AWS/GCP services and Spark workloads.

Skills

Public cloud AWS/Azure/GCP

Python/Scala/Java

Spark/Hadoop (HDFS)

PySpark/Python/Scala/Shell

SQL

RESTful Webservice

Docker/Kubernetes/Git

Azure/AWS services (EMR, S3, Lambda, R

Data infrastructure design

Education

B.E. or B.Tech

Tools

Docker

Kubernetes

Git

Azure DevOps

Spark

Job description

About Narayana Health:

Narayana Health is headquartered in Bengaluru, India, and operates a network of hospitals in India and Overseas. Our mission is to deliver high quality, affordable healthcare services to the broader population. Narayana Health Group is Indias leading healthcare provider and one of the largest hospital groups in the country with a network of 21 hospitals, 5 heart centers, and 19 primary care facilities. The NH group treats over 2.6 Million patients every year from over 78 countries covering 30+ medical specialties.

Our Centers of Excellence help in treating Adult & Pediatric patients and we have one of the largest transplant centers in India. We have a strong presence across 17 locations in India, and an overseas hospital in the Cayman Islands, USA. Two of our hospitals have international accreditation from the Joint Commission International (JCI) and 19 hospitals have domestic accreditation from National Accreditation Board for Hospitals (NABH).

For more details, please refer to our website at: https://www.narayanahealth.org

About Medha AI:

Medha Analytics works to simplify healthcare by unleashing the potential of data. With a powerful tech-stack, interesting ideas and inspired co-workers, no dream is too big at Medha Analytics. The Medha Analytics Platform, with automated data pipelines, an end-to-end Information Modelling, and a comprehensive suite of AI & Analytics solutions, provides highly personalized and actionable insights at the right time.

For more details, please refer to our website at: https://medha-analytics.ai/

Job Description:

• Understanding business processes, understanding the software systems for retrieval, prepping and modelling data to build/maintain modern data platform for supporting reports and Dashboards.


• Create and maintain optimal data pipeline architecture.


• Assemble large, complex data sets that meet functional/non-functional business requirements.


• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.


• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure technologies.


• Work with stakeholders including the Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.


• Work with data and analytics experts to strive for greater functionality in our data systems.

Candidate Requirement:

Education: B.E. orB.Tech

Experience: 3 to 6 Yrs as Data Engineer

Knowledge & Skills:

• Experience of working on any of the public cloud AWS/Azure/GCP


• Experience working on Python/Scala/Java, Big Data technologies like spark and Hadoop File System (HDFS)


• Strong hands-on experience in writing code in Pyspark/Python/Scala/Shell language using best practices.


• Experience on Performance tuning of Spark Jobs and cluster configurations


• Any one


• Knowledge of AWS services viz., EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDS, GLUE ETL is desired.


• Knowledge of Azure services viz., ADF, Databricks, Azure Synapse Analytics, ADLS Gen2,Azure Devops is desired.


• Proficient in writing highly optimized SQLs and algorithm for data processing


• Sound understanding of the cloud relational and non-relation database, their storage concepts, best practices and use case.


• Knowledge in RESTful Webservice, Microsoft SQL Server, MySQL Server, and Agile methodology is an advantage.


• DevOps toolchain experience is plus (Docker/Kubernetes/Ansible/Git)


• Strong analytical, problem-solving, and communication skills


• Excellent command of both written and spoken English.


• Should be able to Design, Develop, Deliver & maintain Data Infrastructures.