AI or ML Engineer - LLMs, RAG, LangChain, LangGraph

UnitedHealth Group; Bengaluru; On-site; Confidential; Full time

Job summary

UnitedHealth Group is seeking an experienced AI Engineer to design, build, and deploy enterprise-grade AI solutions focusing on Agentic AI, RAG, and AI workflow automation. You will work with Spring AI, LangChain, LangGraph, and cloud platforms such as AWS and Azure.

The role requires strong engineering mindset, hands-on LLM-based development, and collaboration with product owners and data engineers to deliver scalable AI-powered applications.

Qualifications

• Graduate degree or equivalent experience.
• 5+ years software engineering experience.
• Hands-on experience building AI/ML or GenAI apps.
• Experience with Agentic AI concepts and multi-agent workflows.
• Knowledge of vector databases and retrieval pipelines.
• Experience with cloud AI services (AWS/AZURE) and DevOps.

Responsibilities

• Design, build, and deploy AI solutions with LLMs and memory.
• Implement RAG-based apps with embeddings and retrieval strategies.
• Develop AI-powered workflow automation to improve efficiency.
• Integrate AI into enterprise apps and microservices.
• Build backend services using Java/Spring Boot and/or Python.
• Ensure observability, guardrails, and monitoring for AI apps.
• Work with cloud services on AWS and Azure for AI workloads.
• Collaborate with stakeholders to translate problems into solutions.
• Evaluate emerging AI tech and ensure security/compliance.

Skills

Java/Spring Boot

Python

LLM-based apps

Agentic AI

RAG architectures

LangChain

LangGraph

AWS

Azure

CI/CD

Docker

Kubernetes

Observability tools

REST/microservices

Vector databases

Education

Bachelors or Masters in CS/Engineering/Data Science/AI/ML

Tools

Git

CI/CD pipelines

Spring AI

Azure OpenAI / AWS Bedrock

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

We are looking for an experienced AI Engineer to design, build, and deploy enterprise-grade AI solutions, with a solid focus on Agentic AI, Retrieval-Augmented Generation (RAG), AI workflow automation, and intelligent application development. The ideal candidate should have hands‑on experience building production-ready AI systems using frameworks such as Spring AI, LangChain, LangGraph, and cloud platforms including AWS and Azure.

The role requires a solid engineering mindset, practical experience with LLM-based application development, and the ability to translate business problems into scalable AI-powered solutions.

Primary Responsibilities:

• Design, develop, and deploy Agentic AI solutions using LLMs, tools, memory, orchestration, and multi-step reasoning workflows
• Build and maintain RAG-based applications using vector databases, embeddings, document ingestion pipelines, retrieval strategies, and prompt engineering
• Develop AI-powered workflow automation solutions to improve operational efficiency and business process intelligence
• Work with frameworks such as Spring AI, LangChain, LangGraph, and related AI orchestration tools
• Integrate AI capabilities into enterprise applications, APIs, microservices, and cloud-native platforms
• Build scalable backend services using Java/Spring Boot and/or Python-based AI frameworks
• Implement prompt engineering, evaluation, guardrails, observability, and monitoring for AI applications
• Work with cloud services on AWS and Azure, including AI/ML services, storage, compute, serverless, containerization, and deployment pipelines
• Implement observability and monitoring for application health, AI workflow performance, model behavior, latency, failures, and usage patterns
• Collaborate with product owners, architects, data engineers, and business stakeholders to understand requirements and deliver AI solutions
• Evaluate emerging AI technologies, LLM providers, model APIs, and open-source frameworks for enterprise adoption
• Ensure AI solutions follow security, compliance, privacy, and responsible AI best practices
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re‑assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• Graduate degree or equivalent experience
• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, AI/ML, or a related field, or equivalent practical experience
• 5+ years of overall software engineering experience
• Hands‑on experience building AI/ML, GenAI, or LLM-based applications
• Solid experience with Agentic AI concepts, including tool calling, planning, memory, multi‑agent workflows, and autonomous task execution
• Practical experience with RAG architecture, including embeddings, chunking, retrieval, re‑ranking, vector search, and document processing
• Experience with Spring AI, LangChain, and LangGraph
• Experience integrating LLMs such as OpenAI, Azure OpenAI, Anthropic, Amazon Bedrock, or open‑source models
• Experience with Git, CI/CD pipelines, Docker, Kubernetes, and modern DevOps practices
• Experience with Azure OpenAI, AWS Bedrock, SageMaker, Azure AI Foundry, Azure AI Search, or similar cloud‑native AI services
• Experience with observability and monitoring tools such as Splunk, Dynatrace, Amazon CloudWatch, Azure Monitor, and Azure Log Analytics
• Experience with workflow orchestration tools, message queues, or automation platforms
• Cloud experience with AWS and Azure, including services related to AI, compute, storage, APIs, containers, and CI/CD
• Knowledge of vector databases such as Pinecone, Weaviate, Milvus, Chroma, FAISS, OpenSearch, or Azure AI Search
• Knowledge of LLM evaluation, hallucination reduction, grounding, tracing, and observability tools
• Understanding of responsible AI, data privacy, access control, and compliance requirements
• Good understanding of REST APIs, microservices, event‑driven architecture, and enterprise integration patterns
• Familiarity with security and governance practices for GenAI applications
• Demonstrated solid programming skills in Java/Spring Boot and/or Python
• Demonstrated solid problem‑solving skills and ability to build reliable, maintainable, production‑grade systems

Preferred Qualifications:

• AWS, Azure AI Engineer, Kubernetes, DevOps, or cloud architecture certifications
• Knowledge of the US Healthcare domain

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.