Software Engineer III - AI (IND)

Legato; Gurugram District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Carelon Global Solutions India seeks a Software Engineer III - AI to design and deliver cloud-native data platforms and AI-enabled solutions on AWS. You will own technical direction across Python services, Snowflake data warehousing, and production-grade AI/ML engineering for healthcare-grade systems.

The role requires 4+ years in AI engineering, strong knowledge of LLMs, RAG/vector search, and experience with CI/CD/MLOps.

Qualifications

• Minimum education: Bachelor s degree in any Engineering Stream.
• Nice to have certifications.
• Preferred education: Computer Science/Engineering.

Responsibilities

• Lead design and delivery of cloud-native data platforms and AI-enabled solutions on AWS.
• Proven delivery ownership across the SDLC for AI-powered products in production.
• Hands-on with LLM integration patterns, tool calling, and structured outputs.
• Develop and evaluate GenAI systems with eval harnesses and data quality controls.
• Ensure Responsible AI, data minimization, access controls, and security compliance.

Skills

Python

LLM integration

RAG + vector search

GenAI delivery

MLOps / CI-CD

APIs / FastAPI

Education

Bachelor's degree in Engineering

Computer Science/Engineering

Tools

AWS

ECS/EKS

Lambda

Job description

Job Summary

Position Title: Software Engineer III - AI (IND)

Job Family: IFT > Engineering /Dev

Job Title: Software Engineer III - AI

Requirement Type: Full-Time Employee

Job Location: Gurugram/Bangalore

Job Level: Associate

Hiring Manager: Assistant Manager Product Management II

Primary Skill: AI Engineering

Business: VBC, HealthOs

Individual Contributor /People Manager: Individual Contributor

Job Purpose

• Carelon Global Solutions India is seeking a Software Engineer III - AI.
• Reporting to the Assistant Manager Product Management II, you will lead the design and delivery of cloud-native data platforms and AI-enabled solutions on AWS.
• You will own technical direction across Python services, Snowflake data warehousing, and production-grade AI/ML engineering-driving scalable architecture, engineering excellence, and end-to-end delivery for healthcare-grade systems.

Job Responsibilities

• Proven delivery ownership across the SDLC: ability to lead discovery design build test release operate for AI-powered products/services in production.
• Strong Python engineering: production-grade APIs/services (e.g., FastAPI), async/background processing, packaging, type hints, testing, and performance profiling.
• LLM application architecture: hands-on experience with LLM integration patterns (workflow orchestration, tool/function calling, structured outputs, routing, caching, guardrails, fallbacks).
• RAG + vector search expertise: embeddings, chunking strategies, metadata modeling, hybrid retrieval, reranking, index lifecycle, and retrieval tuning using evaluation feedback.
• Evaluation and quality engineering for GenAI: building eval harnesses, golden datasets, regression tests, automated scorecards, A/B testing, and human review workflows.
• Responsible AI and security controls: PII handling, data minimization, content safety, prompt-injection defenses, access controls, audit logging, and compliance-ready design.
• MLOps/LLMOps practices: CI/CD for prompts/models, environment promotion, reproducibility, experiment tracking, and monitoring for quality/cost/latency.
• Cloud and deployment experience (AWS preferred): containerization and orchestration (ECS/EKS), serverless where applicable (Lambda/Step Functions), IAM/KMS/Secrets, VPC/networking basics, and CloudWatch observability.
• Data engineering fundamentals for AI systems: reliable batch/stream pipelines, data quality checks, feature/embedding pipelines, and integration with data stores (object storage + relational/warehouse as needed).
• DevOps and operational excellence: infrastructure-as-code familiarity, release strategies, incident handling, SLO/SLI mindset, and production monitoring/alerting.
• Communication and stakeholder management: translate ambiguous problems into technical plans, manage trade-offs (accuracy vs. latency vs. cost vs. safety), and align with Product/Security/Legal.
• Mentorship and technical leadership: guide design decisions, review code/architecture, and uplift team standards.

Qualification

• Minimum education: Bachelor s degree in any Engineering Stream
• Specialized training, certifications, and/or other special requirements: Nice to have
• Preferred education: Computer Science/Engineering.

Experience

• Minimum relevant experience - 4 years in AI engineering.
• Preferred total experience - 4 years

Skills and Competencies

• Production GenAI delivery experience: proven track record shipping AI/LLM-enabled features to production (not just prototypes), including operating and improving them post-launch.
• LLM integration orchestration: hands-on with LLM application patterns-prompting, structured outputs (JSON schemas), tool/function calling, routing, multi-step workflows/agents, caching, and fallbacks.
• RAG + vector search expertise: embeddings, chunking strategies, retrieval tuning, hybrid search/reranking, metadata filtering, index lifecycle, and grounding/attribution strategies.
• Evaluation-first engineering: ability to design offline/online evaluation (golden datasets, automated scorecards, regression tests), and measure quality across accuracy, safety, latency, and cost.
• Responsible AI security: prompt-injection defenses, data/