AI or ML Engineer - LLMs, RAG, LangChain, LangGraph

Optum India; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Optum India is hiring a senior AI/ML engineer in Bengaluru to design and deploy Agentic AI solutions, using LLMs, memory, and multi-step reasoning workflows. You will build RAG-based apps with vector databases, embeddings, and prompt engineering, while integrating AI capabilities into enterprise applications and cloud-native platforms.

The role requires hands-on experience with Java/Spring Boot or Python AI frameworks, plus proficiency in CI/CD, Docker, and Kubernetes, and a focus on security,

Qualifications

• Graduate degree or equivalent experience in CS/Engineering/Data Science.
• 5+ years of software engineering experience.
• Hands-on AI/ML, GenAI, or LLM-based development experience.

Responsibilities

• Design, develop, and deploy Agentic AI solutions using LLMs, tools, memory, orchestration, and multi-step workflows.
• Build and maintain RAG-based applications with vector databases and embeddings.
• Develop AI-powered workflow automation to improve efficiency and process intelligence.
• Integrate AI into enterprise apps, APIs, microservices, and cloud platforms.
• Build backend services with Java/Spring Boot and Python AI frameworks.
• Implement monitoring, guardrails, and observability for AI apps.
• Collaborate with product owners and engineers to deliver AI solutions.
• Evaluate emerging AI tech and providers for enterprise adoption.

Skills

AI/ML development

Agentic AI concepts

RAG architecture

Java/Spring Boot

Python

CI/CD pipelines

Docker/Kubernetes

REST APIs

Observability

Education

Bachelor's or Master's in CS/Engineering/Data Science

Graduate degree or equivalent experience

Tools

Spring AI

LangChain / LangGraph

OpenAI / Azure OpenAI

Pinecone / Weaviate / Milvus / FAISS

Git & CI/CD

Docker

Kubernetes

Azure/AWS cloud services

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities

• Design, develop, and deploy Agentic AI solutions using LLMs, tools, memory, orchestration, and multi-step reasoning workflows
• Build and maintain RAG-based applications using vector databases, embeddings, document ingestion pipelines, retrieval strategies, and prompt engineering
• Develop AI-powered workflow automation solutions to improve operational efficiency and business process intelligence
• Work with frameworks such as Spring AI, LangChain, LangGraph, and related AI orchestration tools
• Integrate AI capabilities into enterprise applications, APIs, microservices, and cloud-native platforms
• Build scalable backend services using Java/Spring Boot and/or Python-based AI frameworks
• Implement prompt engineering, evaluation, guardrails, observability, and monitoring for AI applications
• Work with cloud services on AWS and Azure, including AI/ML services, storage, compute, serverless, containerization, and deployment pipelines
• Implement observability and monitoring for application health, AI workflow performance, model behavior, latency, failures, and usage patterns
• Collaborate with product owners, architects, data engineers, and business stakeholders to understand requirements and deliver AI solutions
• Evaluate emerging AI technologies, LLM providers, model APIs, and open-source frameworks for enterprise adoption
• Ensure AI solutions follow security, compliance, privacy, and responsible AI best practices
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications

• Graduate degree or equivalent experience
• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, AI/ML, or a related field, or equivalent practical experience
• 5+ years of overall software engineering experience
• Hands-on experience building AI/ML, GenAI, or LLM-based applications
• Solid experience with Agentic AI concepts, including tool calling, planning, memory, multi-agent workflows, and autonomous task execution
• Practical experience with RAG architecture, including embeddings, chunking, retrieval, re-ranking, vector search, and document processing
• Experience with Spring AI, LangChain, and LangGraph
• Experience integrating LLMs such as OpenAI, Azure OpenAI, Anthropic, Amazon Bedrock, or open-source models
• Experience with Git, CI/CD pipelines, Docker, Kubernetes, and modern DevOps practices
• Experience with Azure OpenAI, AWS Bedrock, SageMaker, Azure AI Foundry, Azure AI Search, or similar cloud-native AI services
• Experience with observability and monitoring tools such as Splunk, Dynatrace, Amazon CloudWatch, Azure Monitor, and Azure Log Analytics
• Experience with workflow orchestration tools, message queues, or automation platforms
• Cloud experience with AWS and Azure, including services related to AI, compute, storage, APIs, containers, and CI/CD
• Knowledge of vector databases such as Pinecone, Weaviate, Milvus, Chroma, FAISS, OpenSearch, or Azure AI Search
• Knowledge of LLM evaluation, hallucination reduction, grounding, tracing, and observability tools
• Understanding of responsible AI, data privacy, access control, and compliance requirements
• Good understanding of REST APIs, microservices, event-driven architecture, and enterprise integration patterns
• Familiarity with security and governance practices for GenAI applications
• Demonstrated solid programming skills in Java/Spring Boot and/or Python
• Demonstrated solid problem-solving skills and ability to build reliable, maintainable, production-grade systems

Preferred Qualifications

• AWS, Azure AI Engineer, Kubernetes, DevOps, or cloud architecture certifications
• Knowledge of the US Healthcare domain

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.