Senior Data Engineering Lead

Optum India

Hyderabad

On-site

INR 4,500,000 - 7,000,000

Full time

6 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Optum India is seeking an Hands-on Data Engineering Lead to architect and scale modern data platforms that power analytics, AI, and real-time APIs. You will build robust pipelines using Python/Scala, Spark, SQL, Kafka, and orchestration tools, while advancing cloud-native solutions in Azure.

You will mentor a team of engineers, define coding standards, reviews, and engineering OKRs, and translate business needs into scalable data solutions with strong security and reliability considerations.

Qualifications

  • Bachelor's degree in computer science, engineering, or a related technical field.
  • 8+ years of professional data engineering experience with leadership responsibilities.
  • Hands-on experience with Azure, Apache Spark, Databricks (Python/Scala), and Azure Data Factory.

Responsibilities

  • Architect, build, and scale modern data platforms powering analytics, AI, and real-time APIs.
  • Develop and deploy AI models for analytics using LLM, RAG and Gen AI.
  • Design cloud-native data platforms (Azure Data Lake, Databricks, Snowflake) with batch and streaming.
  • Build robust pipelines using Python/Scala, Spark, SQL, Kafka, and orchestration (Azure Data Factory).
  • Design and deploy REST/GraphQL APIs for data products, ML inference, and feature services.
  • Optimize cost, performance, and reliability; implement observability (lineage, logging, metrics).
  • Mentor engineers; define coding standards, reviews, OKRs.

Skills

Data engineering
Azure
Apache Spark
Databricks
Python
Scala
SQL
Kafka
Azure Data Factory
Git

Education

Bachelor's degree in CS/Engineering

Tools

Azure Data Factory
Databricks
Spark
REST/GraphQL APIs

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities
  • Hands-on Data Engineering Lead to architect, build, and scale modern data platforms that power analytics, AI, and real-time APIs
  • Hands-on experience with AI Tools or platforms, building and deploying AI models for analytics leveraging LLM, RAG and Gen AI
  • Design and implement cloud-native data platforms (e.g., Azure Data Lake, Databricks, Snowflake) with batch, streaming
  • Build robust pipelines using Python/Scala, Spark, SQL, Kafka, and orchestration (Azure Data Factory)
  • Design and deploy REST/GraphQL APIs for curated data products, ML inference, and feature services
  • Optimize cost, performance, and reliability; implement observability (lineage, logging, metrics, alerting)
  • Advanced understanding of data architecture and cloud solutions, especially in Azure
  • Mentor a team of engineers; define coding standards, reviews, and engineering OKRs
  • Translate business needs into scalable data solutions or products, manage stakeholder expectations and delivery timelines
  • Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements
Required Qualifications
  • Bachelor's degree in computer science, Engineering, or a related technical field
  • 8+ years of professional experience in data engineering, data products development, AI tools, including technical leadership
  • Data Engineering Expertise: Hands-on experience with Azure, Apache Spark, Databricks (using Scala and Python), and Azure Data Factory
  • Database Management: Solid experience with SQL and NoSQL databases for efficient data storage and querying
  • Agile & Testing: Familiarity with Agile methodologies, unit testing, and test automation frameworks
  • Version Control: Proficiency with Git or similar systems
  • Solution Architecture: Proven ability to design, implement, and integrate solutions with robust data security measures
  • Performance Optimization: Proven to ensure cross-browser compatibility and optimize applications for scalability and high performance
  • Server-Side Development: Proven to design, develop, and maintain API services and server-side applications
  • AI: GitHub Copilot, M365 Copilot, LLM Models, Gen AI

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineering
Principal Data Engineering

Optum India • Hyderabad

On-site
INR 4,000,000 - 7,000,000
Principal Data Engineering
Principal Data Engineering

UnitedHealth Group • Hyderabad

On-site
INR 4,000,000 - 7,000,000
Principal Data Engineering
Principal Data Engineering

Optum • Hyderabad

Hybrid
INR 4,000,000 - 7,000,000
Senior Data Engineering Lead
Senior Data Engineering Lead

Optum • Hyderabad

On-site
INR 3,500,000 - 5,500,000
Senior Manager Data Engineering
Senior Manager Data Engineering

Optum • Hyderabad

On-site
INR 1,800,000 - 3,600,000
Principal Data Engineer
Principal Data Engineer

Optum India • Bengaluru

On-site
INR 4,000,000 - 9,000,000
Senior Data Engineering Consultant
Senior Data Engineering Consultant

Optum India • Hyderabad

On-site
INR 1,200,000 - 2,400,000
Data Engineering Consultant
Data Engineering Consultant

Optum India • Hyderabad

On-site
INR 2,400,000 - 4,200,000
Senior Data Engineering Consultant
Senior Data Engineering Consultant

UnitedHealth Group • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Associate Data Engineering Manager
Associate Data Engineering Manager

Optum • Bengaluru

On-site
INR 900,000 - 1,500,000