Lead Data Engineer

Delta Technology Hub; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Benefits offered by this job

Medical Insurance

Travel opportunities

Parental Benefits

National Pension Scheme

Job summary

Delta Technology Hub Bangalore seeks a Lead Data Engineer to design, build, and maintain data infrastructure powering Delta's health analytics platform. You will own pipelines transforming vendor healthcare data into AI-ready assets using dbt, Redshift Serverless, and AWS SageMaker, collaborating with data quality, visualization, and data science teams to deliver enterprise-scale healthcare analytics.

You will optimize pipelines, monitor data quality, and enable scalable analytics for executives

Qualifications

• 7-12 years of relevant work experience with data engineering.
• Hands-on with DBT or similar transformation frameworks.
• Cloud data warehouses experience (Redshift, Snowflake or BigQuery).

Responsibilities

• Build and optimize dbt models across staging, intermediate, domain, and marts layers.
• Design and implement data pipelines for healthcare vendor data ingestion and quality validation.
• Develop automated monitoring and alerting to catch data issues before downstream analytics.
• Create ML feature engineering pipelines for SageMaker-based models.

Skills

SQL

Python

dbt

Redshift

Airflow

SageMaker

ETL/ELT

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

dbt

Redshift Serverless

SageMaker

GitHub Actions

Jenkins

Airflow

Job description

How You'll Help Us Keep Climbing (Overview & Key Responsibilities)

About The Team /role Overview

This Lead Data Engineer will be the engine behind our platform's acceleration. Working alongside our infrastructure and automation lead, this role transforms our ability to build reliable, scalable data pipelines that power everything from executive dashboards to AI predictions. Without this foundation, the insights layer cannot exist.

Why This Role Matters

Today, Our Platform Work Is Bottlenecked By Capacity. The Team Manages Some Of The Infrastructure, Automation, And Pipeline Development — All Critical, All Competing For The Same Resource. This Position Unlocks

• Parallel development — build multiple domain data models simultaneously
• AI readiness — dedicated capacity for feature engineering and ML pipelines
• Faster delivery — cut time-to-insight from months to weeks
• Platform stability — proactive monitoring instead of reactive fixes

Position Summary

The Laed Data Engineer designs, builds, and maintains the data infrastructure that powers Delta's Health Intelligence Platform. This role owns the pipelines that transform raw healthcare data from vendors (UMR, UHC, CVS, Spring Health) into clean, trusted, AI-ready data assets. You'll work with modern tools — dbt, Redshift Serverless, AWS SageMaker — and collaborate with data quality, visualization, and data science teams to deliver enterprise-scale healthcare analytics.

Key Responsibilities

• Build and optimize dbt models across staging, intermediate, domain, and marts layers following healthcare data best practices
• Design and implement data pipelines for healthcare vendor data ingestion, transformation, and quality validation
• Develop automated monitoring and alerting to catch data issues before they impact downstream analytics
• Create ML feature engineering pipelines that prepare data for predictive models in SageMaker and Bedrock
• Optimize Redshift performance through query tuning, table design, and workload management
• Build CI/CD pipelines for reliable, automated deployments across environmentsDocument data models and pipelines to enable team knowledge sharing and platform maintainability

What You Need To Succeed (Minimum Qualifications)

• Bachelor’s degree in Relevant Field.
• 7-12 years of relevant work experience, including 3+ years of data engineering experience with SQL and Python
• Hands‑on experience with DBT or similar transformation frameworks
• Experience with cloud data warehouses (Redshift, Snowflake, or BigQuery)
• Strong understanding of data modeling, ETL/ELT patterns, and data quality
• Ability to work independently and collaborate across distributed teams

Behavioral Competencies

• Lead initiatives with high accountability, create a collaborative environment with a solution-based approach.
• Serve as a trusted advisor and mentor for the team offering technical advice.
• Ability to communicate with precision, engaging team and stakeholders to build trust and reliable working relationships across cross-functional teams and geographies enabling organizational alignment.
• Ability to set priorities with the team by understanding interdependence, inspiring team members with consistent focus, quality output, and timelines.
• Constantly keep oneself updated on current technology & trends to drive innovative decisions through piloting forward-thinking approaches to complex problems in one’s own area of work.
• Inquisitive to understand customer priorities and business challenges while creating value for technical solutions.

What Will Give You a Competitive Edge (Preferred Qualifications)

• Healthcare data experience (claims, eligibility, pharmacy, clinical)
• AWS experience (Redshift, SageMaker, Lambda, Step Functions)
• ML feature engineering or model deployment experience
• CI/CD tools (GitHub Actions, Jenkins, or similar)
• Workflow orchestration tools (Airflow, Dagster, or similar)

About The Company

What started as a humble, little aerial crop-dustingoperation called Huff DalandDusters in 1924 has now grown into the U.S. global airline leader in safety, innovation, reliability, and customer experience. Headquartered in Atlanta, Georgia, Delta Air Lines is known for its operational excellence and award-winning customer service.

Powered by our employees worldwide, Delta has led the airline industry in operational excellence for a decade while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good.

In 2026, Delta Air Lines continued to earn global recognition for its performance, culture and operational excellence. Delta was named to Glassdoor’s 2026 Top 100 Best Places to Work list for the ninth time, standing as the only airline recognized. Delta also secured the 11th spot on Fortune’s World’s Most Admired Companies list, marking its 13th consecutive year earning this distinction. Delta was also recognized by Cirium as the top on-time airline in North America for the fifth consecutive year, underscoring its unwavering commitment to reliability and customer experience.

About The Delta Technology Hub (DTH), Bangalore

The DTH is one of Delta Air Lines’ investments in world-class business capabilities and technology aimed at transforming how Delta Air Lines operates and provides world-class travel experiences to its customers through innovation and cutting-edge methodologies. By continuously reimagining processes and driving technology-led transformation, the Delta Technology Hub plays a pivotal role in Scripting The Future Of Aviation. The organization is certified by the Great Place to Work Institute (India). The Delta Technology Hub was a finalist for the iVolunteer Awards 2024/2025 in the "Leader in Employee Volunteering" category. This nomination highlights our remarkable volunteering initiatives and the outstanding practices we implement to encourage and support our employee volunteering program.

For more information, please visit www.deltatechhub.com

Why join?

• Technology is a key enabler of the differentiated services that Delta provides. At the DTH, you get the opportunity to work on projects with a significant impact on business outcomes and customer experience.
• Deepen your knowledge by taking part in multifaceted learning and development programs –exposure to extensive internal and partner repositories, institutional affiliations, and industry SIG (Special Interest Groups) partnerships.
• Immerse yourself in an employee-centric culture.
• Develop deep and broad business acumen on airline operations while retaining focus on cutting-edge technology driven solutions.
• Avail a full range of benefits that support you and your family: Medical Insurance, Transportation to and from the DTH office, Complementary Cafeteria Meals, Special Travel opportunities and Travel Privileges, Car Lease Program, Paid time off, Parental Benefits and National Pension Scheme.