Senior Manager Data Engineering

Optum India; Hyderabad; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Optum India is seeking an experienced Lead Data Engineer to architect and optimize data platforms, pipelines, and governance. You will mentor a team of data engineers, drive CI/CD practices, and collaborate with analytics, BI, and product teams to deliver scalable data assets.

The role requires 10+ years in data engineering/data science, with at least 3 years in a technical leadership position and hands-on experience with SQL, Python, Spark, and modern data tools in a Cloud environment.

Qualifications

• Bachelor's degree or equivalent experience required.
• 10+ years in Data Engineering/Data Science with 3+ years in a technical lead role.
• Experience leading at least 5 resources.
• Strong experience with Azure ecosystem (ADF, Synapse, ADLS) and Snowflake.
• Proficiency in SQL, Python, Spark, and data governance practices.

Responsibilities

• Design and maintain scalable data pipelines (ETL/ELT) and integration solutions.
• Define data modelling standards (dimensional, relational, NoSQL).
• Architect and optimize platforms using Snowflake, Microsoft Fabric, and Azure data services.
• Lead and mentor data engineers; enforce CI/CD and coding best practices.
• Drive adoption of modern tools (Kafka, Airflow, Spark, Fabric, Snowflake).
• Build and optimize batch and real-time pipelines across APIs, databases, and streams.
• Ensure data quality, governance, and compliance (HIPAA, GDPR).
• Collaborate with analytics, BI, data science, and product teams to deliver trusted data assets.

Skills

Data engineering leadership

ETL/ELT with SQL

Python

Spark/PySpark

SQL reporting

PowerBI

Kafka

Airflow

NoSQL data modelling

Data governance & metadata

Education

Bachelor's degree or equivalent experience

Tools

Databricks

Snowflake

Azure (ADF, Synapse, ADLS)

Terraform

Docker/Kubernetes

Purview

PowerBI tooling

Airflow

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Caring. Connecting. Growing together.

Primary Responsibilities

• Data Architecture & Design
  • Design and maintain scalable data pipelines, ETL/ELT workflows, and integration solutions
  • Define data modelling standards (dimensional, relational, NoSQL)
  • Architect and optimise platforms using Snowflake, Microsoft Fabric, and Azure data services
• Technical Leadership
  • Stratergize and recommend AI-enabled solutions that improve data quality, reduce manual effort, and accelerate insight delivery for the reporting domain
  • Lead and mentor data engineers; enforce coding, testing, and CI/CD best practices
  • Drive adoption of modern tools (Kafka, Airflow, Spark, Fabric, Snowflake)
  • Evaluate and implement emerging technologies
• Data Engineering & Optimisation
  • Build and optimise batch and real-time pipelines across APIs, databases, and streams
  • Ensure performance, cost efficiency, scalability, and reliability
  • Automate workflows for resilience
• Data Quality & Governance
  • Implement data validation, lineage, and governance frameworks
  • Ensure compliance (HIPAA, GDPR, etc.) and maintain metadata/catalog tools (Purview, etc.)
• Collaboration & Delivery
  • Partner with business, analytics, and engineering teams to deliver scalable solutions
  • Translate business requirements into technical designs
• Cloud & DevOps
  • Implement cloud-based solutions (Azure preferred; AWS/GCP exposure)
  • Manage CI/CD, IaC (Terraform), monitoring, and cost optimisation
• Production Operations
  • Ensure pipeline reliability, handle incidents, and perform root cause analysis
  • Define SLAs/SLOs and maintain monitoring/runbooks
• Strategy
  • Drive data roadmap and platform modernization
  • Improve data accessibility and align with long-term business goals
• Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements

Required Qualifications

• Bachelor's degree or equivalent experience
• 10+ years in Data Engineering/ Data science with 3+ years in a technical lead and leading/managing at least 5 resources
• 8+ years in Data Engineering (ETL/ELT with SQL, Databricks, Python, Spark/PySpark)
• 5+ years experience and solid expertise in modelling, performance tuning, Streams, secure sharing
• Very solid experience in writing SQL's/SP's for reporting/extracts and minimum 3+ yes experience in PowerBI and analytics/reporting.
• 5+ years with Azure ecosystem (ADF, Synapse, ADLS, Purview) and Snowflake
• 2+ years in DevOps (CI/CD, Git, Terraform, Docker/Kubernetes)
• Experience collaborating with Analytics, BI, Data Science, and Product teams to deliver trusted, reusable, and performant data assets
• Experience with Kafka/Event Hubs and Airflow/Fabric pipelines
• Experience in data modelling, Lakehouse/data lake architectures, and NoSQL systems
• Experience in data governance, metadata, lineage, and compliance standards

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.