Senior Software Engineer- AI

Legato; Gurugram District, Bengaluru; Hybrid; INR 3,500,000 - 7,000,000; Full time

Job summary

Carelon Global Solutions seeks a Senior Software Engineer to build scalable LLM/RAG/agent-based systems in a fast-paced environment. You will architect inference and deployment pipelines, optimize models, and collaborate with data science, research, and product teams to deliver production-ready GenAI solutions.

You will mentor junior engineers, uphold clean code and testing standards, and ensure responsible AI development across projects.

Qualifications

• Advanced Python with NumPy, Pandas, scikit-learn.
• Deep learning with PyTorch / TensorFlow.
• Experience with Hugging Face Transformers and LangChain (prompting & fine-tuning).
• Experience with Agentic AI frameworks: AutoGen, CrewAI, LangGraph.
• Expertise in RAG pipelines, semantic search, vector databases.
• Strong software engineering practices: microservices, TDD, concurrency.
• Ability to prototype and productionize GenAI solutions.

Responsibilities

• Build and deploy scalable LLM, RAG, and agent-based systems.
• Architect LLM inference and deployment pipelines.
• Optimize models for efficient and cost-effective production.
• Collaborate with data science, research, and product teams.
• Ensure clean code, testing, reproducibility, and CI/CD.
• Mentor junior engineers and drive engineering best practices.
• Ensure ethical, secure, and responsible AI development.

Skills

Advanced Python

PyTorch / TensorFlow

LLM frameworks

Agentic AI frameworks

RAG pipelines

Software engineering practices

Prototype and productionize GenAI

Tools

Docker

Kubernetes / Helm

FastAPI

FAISS

Pinecone

Chroma

Git

MLflow

Snowflake

SageMaker

Job description

Job Title

Senior Software Engineer

Requirement Type

Full-Time Employee

Job Location

Bangalore/Gurugram

Job Level

I09

Hiring Manager

Assistant Manager

Primary Skill

Python, Agentic AI, PyTorch / TensorFlow, LLM

ABOUT ELEVANCE HEALTH

Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler.

It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 112 million individuals across 14 states.

A regular in Fortune 500 list, Elevance Health ranked 18 in 2026. Gail Boudreaux, President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 81st rank on this list.

ABOUT CARELON GLOBAL SOLUTIONS

Carelon Global Solutions (CGS) is a healthcare solutions company simplifying complex operational processes to improve the health of the healthcare system.

Previously known as Legato Health Technologies, Carelon Global Solutions (CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health (Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers.

Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient.

OUR MISSION & VALUES

Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More.

Our Values: Leadership | Community | Integrity | Agility | Diversity

JOB RESPONSIBILITY

Key Responsibilities

• Build and deploy scalable LLM, RAG, and agent-based systems
• Architect LLM inference and deployment pipelines
• Optimize models for efficient and cost-effective production
• Collaborate with data science, research, and product teams
• Ensure clean code, testing, reproducibility, and CI/CD
• Mentor junior engineers and drive engineering best practices
• Ensure ethical, secure, and responsible AI development

SKILLS AND COMPETENCIES

• Advanced Python with strong fundamentals in NumPy, Pandas, scikit-learn
• Deep learning expertise in PyTorch / TensorFlow
• Hands-on with LLM frameworks: Hugging Face Transformers, LangChain (prompting & fine-tuning)
• Strong experience with Agentic AI frameworks: AutoGen, CrewAI, LangGraph
• Expertise in RAG pipelines, semantic search, vector databases
• Strong software engineering practices: microservices, TDD, concurrency
• Ability to rapidly prototype and productionize GenAI solutions

Good-to-Have Skills

• Model optimization: Quantization (GPTQ, AWQ), pruning, distillation
• Multimodal AI (text, vision, audio): CLIP, BLIP, Whisper, LLaVA
• LLM serving using FastAPI and vector DBs (FAISS, Pinecone, Chroma)
• CI/CD pipelines, Airflow, Docker, Kubernetes / Helm
• Cloud AI deployments on AWS / Azure / GCP (e.g., SageMaker)
• MLOps & tracking: Git, MLflow
• Data pipelines & ELT/ETL using Snowflake

THE CARELON PROMISE

Aligning with our brand belief of limitless minds are our biggest asset, we offer a world of limitless opportunities to our associates.

It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate.

This world of limitless opportunities thrives in an environment that fosters growth and well-being, and gives you purpose and the feeling of belonging.

LIFE @ CARELON

• Extensive focus on learning and development
• An inspiring culture built on innovation, creativity, and freedom.
• Holistic well-being
• Our culture and initiatives are underpinned by diversity, equity and inclusion
• Varied opportunities for rewards and recognitions
• Competitive health and medical insurance coverage
• Best-in-class amenities and workspaces
• Policies designed with associates at the center.

EQUAL OPPORTUNITY EMPLOYER

Carelon Global Solutions is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

Reasonable Accommodation

Our inclusive culture empowers Carelon Global Solutions to deliver the best results for our customers. We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work.

If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form.