Lead Data Engineer

Cohere Health; Hyderabad; On-site; INR 1,800,000 - 2,500,000; Full time

Job summary

Cohere Health, based in Hyderabad, is seeking a Lead Data Engineer responsible for designing and implementing a cloud-native healthcare data platform. You will lead various data engineering initiatives, ensuring optimal data quality and cost-effective solution delivery.

The ideal candidate will have 8–12 years of experience in Data Engineering, particularly with AWS tools and modern data stacks. Join us to foster an environment of respect and equal opportunity for all.

Qualifications

• 8–12 years of Data Engineering experience.
• Experience leading enterprise-scale data initiatives.
• Proficiency with AWS Glue, S3, and Lake Formation.

Responsibilities

• Lead Data Engineering Initiatives.
• Drive technical execution from design through production deployment.
• Implement data quality frameworks and monitor data integrity.

Skills

Data Engineering experience

Cloud Technologies

AWS S3

API security controls

Apache Iceberg

Python

SQL

Data Quality frameworks

Tools

dbt

Apache Airflow

PySpark

Job description

Opportunity Overview

We are seeking a Lead Data Engineer to drive the design and delivery of our cloud‑native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands‑on engineering with technical leadership and collaboration across platform, analytics, and business teams.

What You’ll Do

• Lead Data Engineering Initiatives
• Lead delivery of complex data engineering projects across multiple teams
• Drive technical execution from design through production deployment
• Establish scalable implementation patterns Build and Optimize Data Platforms
• Design and implement batch and near‑real‑time pipelines
• Build reusable ingestion, transformation, validation, and publishing frameworks
• Support modernization of legacy workloads Lakehouse Engineering
• Lead Apache Iceberg implementation and optimization
• Define standards for schema evolution, partitioning, compaction, and metadata management
• Ensure efficient storage and query performance Data Quality and Reliability
• Implement data quality frameworks
• Drive observability and monitoring practices
• Improve operational excellence and reliability Technical Leadership
• Review architecture and design proposals
• Conduct code reviews and engineering reviews
• Mentor engineers and establish best practices

Required Qualifications

• 8–12 years of Data Engineering experience.
• Experience leading enterprise‑scale data initiatives Cloud Technologies
• AWS S3, Glue, Athena, Lake Formation
• IAM and security controls Modern Data Stack
• Apache Iceberg (preferred)
• Delta Lake / Hudi
• dbt
• Airflow or Step FunctionsProgramming
• Python
• SQL
• PySpark / Spark

Equal Opportunity Statement

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all. To us, it’s personal.