Software Engineer III - AI (IND)

Carelon Global Solutions India LLP; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Carelon Global Solutions India LLP seeks a Software Engineer III - AI to design and deliver cloud-native AI platforms on AWS, overseeing Python services and Snowflake data warehousing. You will contribute to production-grade AI/ML engineering and lead technical direction under the Assistant Manager Product Management II.

You will drive scalable architecture, SDLC ownership, LLM integration, RAG/vector search, and robust DevOps practices for healthcare-grade systems.

Qualifications

• Bachelor’s degree in Engineering; CS/Engineering preferred.
• 4 years in AI engineering.
• Strong Python engineering and production API experience.

Responsibilities

• Lead discovery → design → build → test → release → operate for AI-powered products in production.
• Develop production-grade Python APIs/services (FastAPI) and async processing.
• Design and implement LLM integration patterns, tool calling, routing and caching.
• Implement RAG + vector search: embeddings, chunking, metadata, hybrid retrieval and indexing.
• Create eval harnesses, golden datasets, regression tests, and A/B testing for GenAI quality.
• Ensure responsible AI and security controls: PII handling, access controls, audit logs.
• Advance MLOps/LLMOps: CI/CD, environment promotion, monitoring and reproducibility.
• Establish cloud/deployment practices on AWS: ECS/EKS, Lambda, IAM, VPC, CloudWatch.

Skills

AI engineering

Python

LLM integration

Data pipelines

AWS

DevOps

Observability

Security/Responsible AI

MLOps

System design

Education

Bachelor's degree in Engineering

Computer Science/Engineering

Tools

AWS

ECS/EKS

Lambda

Step Functions

Snowflake

Terraform

CI/CD tooling

Job description

Position Title: Software Engineer III - AI (IND) Job Family: IFT > Engineering/Dev Shift: Job Description: Job Title Software Engineer III - AI Requirement Type Full-Time Employee Job Location Gurugram/Bangalore Job Level Associate Hiring Manager Assistant Manager Product Management II Primary Skill AI Engineering Business VBC, HealthOs Individual Contributor /People Manager Individual Contributor

ABOUT ELEVANCE HEALTH

Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 112 million individuals across 14 states. A regular in Fortune 500 list, Elevance Health ranked 18 in 2026. Gail Boudreaux, President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 81st rank on this list.

ABOUT CARELON GLOBAL SOLUTIONS

Carelon Global Solutions (CGS) is a healthcare solutions company simplifying complex operational processes to improve the health of the healthcare system. Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health (Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers. Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient.

OUR MISSION & VALUES

Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More. Our Values: Leadership | Community | Integrity | Agility | Diversity

JOB PURPOSE

Carelon Global Solutions India is seeking a Software Engineer III - AI . Reporting to the Assistant Manager Product Management II, you will lead the design and delivery of cloud-native data platforms and AI-enabled solutions on AWS. You will own technical direction across Python services, Snowflake data warehousing, and production-grade AI/ML engineering—driving scalable architecture, engineering excellence, and end-to-end delivery for healthcare-grade systems.

JOB RESPONSIBILITY

• Proven delivery ownership across the SDLC: ability to lead discovery → design → build → test → release → operate for AI-powered products/service in production.
• Strong Python engineering: production-grade APIs/services (e.g., FastAPI), async/background processing, packaging, type hints, testing, and performance profiling.
• LLM application architecture: hands-on experience with LLM integration patterns (workflow orchestration, tool/function calling, structured outputs, routing, caching, guardrails, fallbacks).
• RAG + vector search expertise: embeddings, chunking strategies, metadata modeling, hybrid retrieval, reranking, index lifecycle, and retrieval tuning using evaluation feedback.
• Evaluation and quality engineering for GenAI: building eval harnesses, golden datasets, regression tests, automated scorecards, A/B testing, and human review workflows.
• Responsible AI and security controls: PII handling, data minimization, content safety, prompt-injection defenses, access controls, audit logging, and compliance-ready design.
• MLOps/LLMOps practices: CI/CD for prompts/models, environment promotion, reproducibility, experiment tracking, and monitoring for quality/cost/latency.
• Cloud and deployment experience (AWS preferred): containerization and orchestration (ECS/EKS), serverless where applicable (Lambda/Step Functions), IAM/KMS/Secrets, VPC/networking basics, and CloudWatch observability.
• Data engineering fundamentals for AI systems: reliable batch/stream pipelines, data quality checks, feature/embedding pipelines, and integration with data stores (object storage + relational/warehouse as needed).
• DevOps and operational excellence: infrastructure-as-code familiarity, release strategies, incident handling, SLO/SLI mindset, and production monitoring/alerting.
• Communication and stakeholder management: translate ambiguous problems into technical plans, manage trade-offs (accuracy vs. latency vs. cost vs. safety), and align with Product/Security/Legal.
• Mentorship and technical leadership: guide design decisions, review code/architecture, and uplift team standards.

QUALIFICATION

• Minimum education: Bachelor’s degree in any Engineering Stream Specialized training, certifications, and/or other special requirements: Nice to have
• Preferred education: Computer Science/Engineering.

EXPERIENCE

• Minimum relevant experience – 4 years in AI engineering.
• Preferred total experience – 4 years

SKILLS AND COMPETENCIES

• Production GenAI delivery experience: proven track record shipping AI/LLM-enabled features to production (not just prototypes), including operating and improving them post-launch.
• LLM integration & orchestration: hands‑on with LLM application patterns—prompting, structured outputs (JSON schemas), tool/function calling, routing, multi‑step workflows/agents, caching, and fallbacks.
• RAG + vector search expertise: embeddings, chunking strategies, retrieval tuning, hybrid search/reranking, metadata filtering, index lifecycle, and grounding/attribution strategies.
• Evaluation-first engineering: ability to design offline/online evaluation (golden datasets, automated scorecards, regression tests), and measure quality across accuracy, safety, latency, and cost.
• Responsible AI & security: prompt‑injection defenses, data/privacy controls (PII redaction/minimization), content safety/guardrails, access control, audit logs, and compliance‑ready designs.
• Model/service productionization: build and deploy inference services (Python APIs), manage latency/cost trade‑offs, rate limiting, retries/timeouts, and resilience under load.
• Observability for AI systems: tracing, structured logs, metrics for latency/tokens/cost, quality monitoring, error analysis loops, and SLO mindset for AI user journeys.
• Data fundamentals for AI: building reliable data/embedding pipelines, data quality checks, and working knowledge of warehouses/lakes to support AI features.
• Cloud & DevOps: AWS‑based deployment (ECS/EKS/Lambda/Step Functions), CI/CD, IaC (Terraform/CloudFormation), and secure secrets/key management.
• Strong Python engineering: clean code, testing (unit/integration/contract), code quality tooling, and maintainable service architecture.
• System design & communication: ability to translate ambiguous product needs into scalable AI system designs, make trade‑offs explicit, and collaborate with Product/Security/Legal.
• Leadership: mentor engineers, lead design reviews, and establish standards for AI engineering (evaluation, safety, reliability, and release practices).

THE CARELON PROMISE

Aligning with our brand belief of ‘limitless minds are our biggest asset’, we offer a world of limitless opportunities to our associates. It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate. This world of limitless opportunities thrives in an environment that fosters growth and well‑being, and gives you purpose and the feeling of belonging.

LIFE @ CARELON

Extensive focus on learning and development An inspiring culture built on innovation, creativity, and freedom.

Holistic well‑being Our culture and initiatives are underpinned by diversity, equity and inclusion.

Varied opportunities for rewards and recognitions Competitive health and medical insurance coverage Best-in-class amenities and workspaces Policies designed with associates at the center.

EQUAL OPPORTUNITY EMPLOYER

Carelon Global Solutions is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

Reasonable Accommodation Our inclusive culture empowers Carelon Global Solutions to deliver the best results for our customers. We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work. If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form.

Disclaimer: Offered designation titles differ*

Job Type: Full time Take your career to the next level by creating solutions for tomorrow, today.

Think limitless. Watch the video to see how the associates at Carelon are creating happy Mondays by inspiring change Being a great place to work means having an inclusive workplace that consistently invests in your holistic growth and wellbeing. Watch the video to catch a glimpse of our inclusive office spaces. At Carelon Global Solutions, we lead with purpose and heart, because we care. So, join our team of innovators and let’s advance healthcare together.

LinkedIn Facebook You Tube Instagram