Senior Software Engineer - Artificial Intelligence

Carelon Global Solutions; Bengaluru; On-site; INR 2,400,000 - 3,600,000; Full time

Job summary

Carelon Global Solutions is seeking a Software Engineer III with senior associate experience to design and deploy scalable LLM/RAG-based systems in Bengaluru. You will contribute to inference pipelines, model optimization, and collaboration with data science, research, and product teams to deliver impactful AI solutions.

Join a fast-moving environment emphasizing reproducibility, robust CI/CD, and responsible AI development, while mentoring peers and upholding engineering excellence across

Qualifications

• Requires BA/BS in IT, CS or related field.
• Strong problem-solving and analytical skills for translating AI concepts into scalable engineering solutions.
• Experience prototyping GenAI/LLM-based applications with collaboration across data scientists and product teams.

Responsibilities

• Build and deploy scalable LLM, RAG, and agent-based systems.
• Architect LLM inference and deployment pipelines.
• Optimize models for production efficiency and cost.
• Collaborate with data science, research, and product teams.
• Ensure clean code, testing, and CI/CD practices.
• Mentor junior engineers and promote engineering best practices.
• Ensure ethical, secure, and responsible AI development.

Skills

LLM optimization

RAG systems

Agent-based AI

LLM serving

CI/CD pipelines

Docker/Kubernetes

Cloud AI deployments

Education

BA/BS in Information Technology/CS

Tools

Git

MLflow

Snowflake

FastAPI

Job description

Software Engineer III (IND)- Artificial Intelligence-GR-39944-72521-JR189262 Position Title: Software Engineer III (IND)- Artificial Intelligence-GR-39944-72521-JR189262 Job Family: IFT > Engineering/Dev Shift: Job Description: Job Title Software Engineer III Requirement Type Full-Time Employee Job Location Bangalore Requirement Level Senior Associate Hiring Manager Delivery Manager Primary Skill LLM, RAG, Gen AI Business EDA Skill Category Super Super Niche

ABOUT ELEVANCE HEALTH

Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 46 million lives across 14 states. A regular in the Fortune 500 list, Elevance ranked 20 in 2025. Gail Boudreaux , President and CEO of Elevance has been a consistent name in the Fortune list of most powerful women and currently holds 53rd rank on this list.

ABOUT CARELON

Carelon Global Solutions (CGS) is a healthcare solutions company that is simplifying complex operational processes to improve the health of the healthcare system. Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health ( Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers. Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, Limerick in Ireland and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective and efficient.

OUR MISSION & VALUES

Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More. Our Values: Leadership | Community | Integrity | Agility | Diversity

JOB POSITION

Carelon Global Solutions is looking for Software Engineer experience working on scalable LLM, RAG, and agent-based systems, LLM inference and deployment pipelines .

JOB RESPONSIBILITY

• Build and deploy scalable LLM, RAG, and agent-based systems
• Architect LLM inference and deployment pipelines
• Optimize models for efficient and cost-effective production
• Collaborate with data science, research, and product teams
• Ensure clean code, testing, reproducibility, and CI/CD
• Mentor junior engineers and drive engineering best practices
• Ensure ethical, secure, and responsible AI development

QUALIFICATION

Requires an BA/BS degree in Information Technology, Computer Science or related field of study. EXPERIENCE Strong problem-solving and analytical skills, with the ability to translate complex AI concepts into scalable engineering solutions. Ability to rapidly prototype and iterate on GenAI and LLM-based applications, balancing innovation with performance and reliability. Effective collaboration across cross-functional teams, including data scientists, researchers, and product stakeholders, to deliver impactful AI solutions. Clear and concise communication skills, capable of presenting technical ideas to both technical and non-technical audiences. Commitment to engineering excellence, including writing clean, maintainable code, conducting thorough code reviews, and following best practices in software development. Proactive learning mindset, staying current with emerging trends in AI, GenAI, and agentic systems, and applying them to real-world problems. Experience in mentoring and knowledge sharing, supporting junior engineers and contributing to team growth and capability building. Ownership and accountability in delivering high-quality solutions under tight deadlines and evolving requirements. Focus on reproducibility and reliability, using tools like Git, MLflow, and CI/CD pipelines to ensure consistent experimentation and deployment. Ethical and responsible AI development, with awareness of safety, fairness, and privacy considerations in model design and deployment.

SKILLS AND COMPETENCIES

• Model optimization: Quantization (GPTQ, AWQ), pruning, distillation
• Multimodal AI (text, vision, audio): CLIP, BLIP, Whisper, LLaVA
• LLM serving using FastAPI and vector DBs ( FAISS, Pinecone, Chroma )
• CI/CD pipelines , Airflow, Docker, Kubernetes / Helm
• Cloud AI deployments on AWS / Azure / GCP (e.g., SageMaker)
• MLOps & tracking: Git, MLflow
• Data pipelines & ELT/ETL using Snowflake

THE CARELON PROMISE

Aligning with our brand belief of ‘limitless minds are our biggest asset’, we offer a world of limitless opportunities to our associates. It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate. This world of limitless opportunities thrives in an environment that fosters growth and well-being, and gives you purpose and the feeling of belonging.

LIFE @ CARELON

Extensive focus on learning and development An inspiring culture built on innovation, creativity, and freedom.

• Holistic well-being
• Comprehensive range of rewards and recognitions
• Competitive health and medical insurance coverage
• Best-in-class amenities and workspaces
• Policies designed with associates at the center.

EQUAL OPPORTUNITY EMPLOYER

Carelon is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

Reasonable Accommodation Our inclusive culture empowers Carelon to deliver the best results for our customers. We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work. If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form.

Disclaimer: Offered designation titles differ*

Job Type: Full time Experience Level Senior Level