Databricks - Tech Lead II - GR - 40516-75564 - JR206256

Carelon Global Solutions India LLP; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Carelon Global Solutions India LLP is seeking a Tech Lead II to guide data engineering initiatives. You will lead scalable data pipelines on Databricks, leveraging Python and PySpark to deliver enterprise-grade solutions.

You will collaborate with architects, product owners, and stakeholders to translate requirements into scalable data lakehouse architectures on AWS/GCP, while driving code reviews, best practices, and CI/CD integration.

Qualifications

• B.Tech degree/MCA with computer science background or equivalent experience.
• 7 years total experience with minimum 3 years relevant in Databricks.
• Proven hands-on Databricks experience including scalable data lakehouse solutions.
• Strong Python and PySpark for enterprise pipelines and distributed processing.
• Extensive Snowflake experience: data modeling, tuning, cost management.
• Hands-on with Apache Iceberg, Delta Lake and modern open table formats.
• Strong understanding of AWS/GCP cloud services, architecture & deployment.
• Experience building batch and real-time pipelines using Spark, Kafka, and cloud services.
• Experience leading development teams and delivering data modernization programs.

Responsibilities

• Lead development and implementation of scalable data engineering solutions.
• Drive end-to-end data pipeline development using Databricks and Python.
• Design batch and real-time data processing frameworks.
• Review code and establish engineering best practices.
• Guide teams on performance optimization and reliability improvements.
• Build and maintain ETL/ELT pipelines with Databricks, Spark, and Python.
• Develop scalable data lakehouse architectures.
• Implement data quality, governance, and observability frameworks.

Skills

Databricks

Python

PySpark

Spark SQL

Cloud - AWS/GCP

CI/CD

Kubernetes

Snowflake

Apache Iceberg

Education

B.Tech

MCA

Tools

Snowflake

Apache Iceberg

Delta Lake

Terraform

Docker

Kubernetes

Job description

Position Title: Databricks - Tech Lead II - GR - 40516-75564 - JR206256 Job Family: IFT > Engineering/Dev Shift: Job Description: Job Title Tech Lead II Requirement Type Full-Time Employee Job Location Bangalore/Gurugram Job Level Lead Hiring Manager Senior Delivery Manager Primary Skill Databricks, AWS/GCP Business EDA Platform Individual Contributor / People Manager Individual Contributor

ABOUT ELEVANCE HEALTH

Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 112 million individuals across 14 states. A regular in Fortune 500 list, Elevance Health ranked 18 in 2026. Gail Boudreaux, President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 81st rank on this list.

ABOUT CARELON GLOBAL SOLUTIONS

Carelon Global Solutions (CGS) is a healthcare solutions company simplifying complex operational processes to improve the health of the healthcare system. Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health (Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers. Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient.

OUR MISSION & VALUES

Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More.

Our Values: Leadership | Community | Integrity | Agility | Diversity

JOB PURPOSE

Carelon Global Solutions India is seeking for a Tech Lead II.

JOB RESPONSIBILITY

Technical Leadership

• Lead development and implementation of scalable data engineering solutions.
• Drive end-to-end data pipeline development using Databricks and Python.
• Design batch and real-time data processing frameworks.
• Review code and establish engineering best practices.
• Guide teams on performance optimization and reliability improvements.

Data Engineering & Analytics

• Build and maintain ETL/ELT pipelines using Databricks, Spark, and Python.
• Develop scalable data lakehouse architectures.
• Implement data quality, governance, and observability frameworks.
• Optimize Snowflake workloads and data models.
• Design Iceberg-based data lakes for large-scale analytics.

Cloud & Platform Engineering

• Work with AWS/GCP cloud services.
• Develop cloud-native data solutions using managed services.
• Awareness of CI/CD pipelines and Infrastructure as Code.
• Support platform modernization and cloud migration initiatives.

Stakeholder Management

• Partner with architects, product owners, and business stakeholders.
• Translate business requirements into technical solutions.
• Provide effort estimation and delivery planning.

QUALIFICATION

B.Tech degree/MCA with computer science background or equivalent experience.

7 years of total and minimum 3 years of relevant experience in Databricks.

Proven hands-on experience with Databricks , including designing and implementing scalable data lakehouse solutions.

Strong expertise in Python and PySpark for developing enterprise-grade data pipelines and distributed processing frameworks.

Extensive experience with Snowflake, including data modeling, performance tuning, query optimization, and cost management.

Hands-on experience with Apache Iceberg, Delta Lake, and modern open table formats for large-scale data lake implementations.

Strong understanding of AWS/GCP cloud services, architecture design, deployment, and platform operations.

Experience in building batch and real-time data processing pipelines using Spark, Kafka, and cloud-native services.

Proven expertise in ETL/ELT design, data integration, and cloud migration initiatives.

Experience leading development teams and delivering data modernization programs.

Strong troubleshooting and analytical skills with the ability to resolve complex production issues.

Excellent stakeholder management and communication skills, working across technical and business teams.

SKILLS AND COMPETENCIES

• Expert knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and Performance Optimization.
• Strong proficiency in Python, PySpark, Spark SQL, and distributed data processing.
• Extensive hands-on experience with Snowflake, including Snowpipe, Streams, Tasks, Data Sharing, and Query Optimization.
• Strong expertise in Apache Iceberg, open table formats, schema evolution, partitioning, and time-travel capabilities.
• Experience designing and implementing large-scale Data Engineering and ETL/ELT Pipelines.
• Hands-on experience with AWS/Azure/GCP cloud-native data services.
• Strong SQL and data modeling skills across OLTP and analytical environments.
• Experience with Real-Time Data Processing using Kafka, Event Hubs, Kinesis, or Pub/Sub.
• Knowledge of Data Governance, Metadata Management, Data Quality, and Security frameworks.
• Good to Have Experience with Terraform, CloudFormation, or Infrastructure as Code (IaC).
• Knowledge of Docker, Kubernetes, and containerized data platforms.
• Experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, or GitLab.
• Exposure to AI/ML, MLOps, and GenAI data platform integration.
• Knowledge of Data Mesh, Data Fabric, and modern enterprise data architectures.
• Databricks, Snowflake, and Cloud platform certifications.

THE CARELON PROMISE

Aligning with our brand belief of ‘limitless minds are our biggest asset’, we offer a world of limitless opportunities to our associates. It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate. This world of limitless opportunities thrives in an environment that fosters growth and well-being, and gives you purpose and the feeling of belonging.

LIFE @ CARELON

• Extensive focus on learning and development
• An inspiring culture built on innovation, creativity, and freedom.
• Holistic well-being
• Our culture and initiatives are underpinned by diversity, equity and inclusion
• Varied opportunities for rewards and recognitions
• Competitive health and medical insurance coverage
• Best-in-class amenities and workspaces
• Policies designed with associates at the center.

EQUAL OPPORTUNITY EMPLOYER

Carelon Global Solutions is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

Reasonable Accommodation Our inclusive culture empowers Carelon Global Solutions to deliver the best results for our customers.

We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work.

If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form.

Disclaimer: Offered designation titles differ*

Job Type: Full time Take your career to the next level by creating solutions for tomorrow, today. Think limitless. Watch the video to see how the associates at Carelon are creating happy Mondays by inspiring change

Being a great place to work means having an inclusive workplace that consistently invests in your holistic growth and wellbeing. Watch the video to catch a glimpse of our inclusive office spaces. At Carelon Global Solutions, we lead with purpose and heart, because we care. So, join our team of innovators and let’s advance healthcare together. LinkedIn Facebook You Tube Instagram