Microservices LLM-Senior Software Engineer III - AI71847-5 (Sector 48)

Carelon Global Solutions; India; On-site; INR 700,000 - 1,100,000; Full time

Job summary

Carelon Global Solutions India is seeking a Senior Software Engineer III AI to architect and deliver AI-enabled microservices and scalable data pipelines. The role involves collaborating with data scientists and product teams to integrate AI/ML models into production-grade solutions.

You will work on state-of-the-art LLM inference, model optimization, and orchestration platforms, with a focus on healthcare domain applications within CGS. Strong Python and cloud-native skills are required.

Qualifications

• Bachelor's degree in Engineering or related field.
• CS/Engineering background preferred.
• Minimum 5+ years in AI engineering or related field.

Responsibilities

• Develop and maintain microservice architecture and API management for AI solutions.
• Collaborate with data scientists and product managers to integrate AI models.
• Design scalable data pipelines and optimize ML models for production.

Skills

Python

LLM

FastAPI

Kubernetes

Microservices

gRPC/REST

MLOps

Education

Bachelor's degree in Engineering

CS/Engineering background

Tools

Terraform

CloudFormation

Pulumi

GitHub Actions

Jenkins

MLflow

DVC

Job description

Job Title Senior Software Engineer III - AI

Requirement Type Full-Time Employee

Job Location Bangalore/Hyderabad/Gurugram

Requirement Level Senior Associate

Hiring Manager Assistant Manager

Primary Skill Microservices LLM, Python, FastAPI, Vector DB(Qdrant, Chromadb, stc), RAG, MLOps & Deployment, Cloud, Agentic AI Framework, Kubernetes

Business Claim Payment & Accuracy

Skill Category Super Super Niche

ABOUT ELEVANCE HEALTH

is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 46 million lives across 14 states.

A regular in the list, Elevance ranked 20 in 2025. , President and CEO of Elevance has been a consistent name in the Fortune list of most powerful women and currently holds 53rd rank on this list.

ABOUT CARELON (CGS)

Carelon Global Solutions (CGS) is a healthcare solutions company that is simplifying complex operational processes to improve the health of the healthcare system.

Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers.

Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, Limerick in Ireland and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective and efficient.

OUR MISSION & VALUES

Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More.

Our Values: Leadership | Community | Integrity | Agility | Diversity

JOB POSITION

Carelon Global Solutions India is seeking for a Senior Software Engineer III AI.

JOB RESPONSIBILITY

• Develop and maintain microservice architecture and API management solutions using REST and gRPC for seamless deployment of AI solutions.
• Collaborate with cross-functional teams, including data scientists and product managers, to acquire, process, and manage data for AI/ML model integration and optimization.
• Design and implement robust, scalable, and enterprise-grade data pipelines to support state-of-the-art AI/ML models.
• Debug, optimize, and enhance machine learning models, ensuring quality assurance and performance improvements.
• Familiarity with tools like Terraform, CloudFormation, and Pulumi for efficient infrastructure management.
• Create and manage CI/CD pipelines using Git-based platforms (e.g., GitHub Actions, Jenkins) to ensure streamlined development workflows.
• Operate container orchestration platforms like Kubernetes, with advanced configurations and service mesh implementations, for scalable ML workload deployments.
• Design and build scalable LLM inference architectures, employing GPU memory optimization techniques and model quantization for efficient deployment.
• Engage in advanced prompt engineering and fine-tuning of large language models (LLMs), focusing on semantic retrieval and chatbot development.
• Document model architectures, hyperparameter optimization experiments, and validation results using version control and experiment tracking tools like MLflow or DVC.
• Research and implement cutting-edge LLM optimization techniques, such as quantization and knowledge distillation, ensuring efficient model performance and reduced computational costs.
• Collaborate closely with stakeholders to develop innovative and effective natural language processing solutions, specializing in text classification, sentiment analysis, and topic modeling.
• Design and execute rigorous A/B tests for machine learning models, analyzing results to drive strategic improvements and decisions.
• Stay up-to-date with industry trends and advancements in AI technologies, integrating current methodologies and frameworks to continually enhance the AI engineering function.
• Contribute to creating specialized AI solutions in healthcare, leveraging domain-specific knowledge for task adaptation and deployment.

QUALIFICATION

• Minimum education: Bachelors degree in any Engineering Stream
• Specialized training, certifications, and/or other special requirements: Nice to have
• Preferred education: Computer Science/Engineering.

EXPERIENCE

• Minimum relevant experience - 5+ years in AI Engineering
• Preferred total experience 8 years

SKILLS AND COMPETENCIES

Technical Skills:

• Advanced proficiency in Python with expertise in data science libraries (NumPy, Pandas Descripti