AI / LLM Engineer

Infosys; Maharashtra; Hybrid; INR 2,800,000 - 5,200,000; Full time

Job summary

Infosys in Maharashtra is seeking an experienced software/AI engineer to design and productionize LLM-powered workflows, focusing on retrieval-augmented generation, document ingestion, embeddings, and grounding.

You will collaborate with backend and DevOps teams to containerize services, implement evaluation routines, and ensure responsible AI practices across pipelines.

Applicants should have 7–10 years in software/AI roles and deep hands-on Python, REST, and AI tooling experience.

Qualifications

• 7–10 years of experience in software/AI-related roles.
• Strong Python programming experience with LLM-based application development.
• Experience with RAG, vector databases, embeddings and prompt engineering.
• Familiarity with LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI or equivalents.
• Knowledge of REST APIs, microservices, SQL and Git workflows.
• Understanding NLP, document extraction, semantic search and evaluation methods.
• Ability to build production-ready AI components and workflows.
• Experience with AI governance, prompt registry and audit trails.

Skills

Python

LLM-based development

RAG

Vector databases

Embeddings

Prompt engineering

LangChain

REST APIs

Microservices

SQL

Git workflows

NLP

AI governance

MLOps

Containerization

Tools

LangChain

LangGraph

LlamaIndex

Semantic Kernel

AutoGen

CrewAI

Job description

• Minimum 7–10 years of experience in software engineering, AI/ML engineering, applied ML, data science engineering or related roles.
• Strong hands-on Python programming experience and practical exposure to LLM-based application development.
• Experience with RAG, vector databases, embeddings, prompt engineering, evaluation frameworks and AI service integration.
• Experience with frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI or equivalent tools.
• Working knowledge of REST APIs, microservices, SQL, structured data concepts, Git workflows, testing and software engineering practices.
• Understanding of document extraction, semantic search, NLP, retrieval quality, hallucination risk, prompt safety and AI evaluation methods.
• Ability to build production-oriented AI components rather than isolated proof-of-concept demos.
• Design and implement LLM-powered workflows for summarization, narrative generation, classification, extraction, contextual reasoning, explanation and reviewer-assist use cases.
• Build retrieval-augmented generation pipelines including document ingestion, chunking, embedding generation, metadata tagging, vector indexing, retrieval tuning and grounded response generation.
• Develop reusable prompt templates, prompt versions, context builders, response schemas, evaluation routines and AI orchestration services.
• Integrate with enterprise AI services such as Azure OpenAI, Azure AI Foundry, OpenAI APIs, Google Gemini, Anthropic, Hugging Face or equivalent approved platforms.
• Implement AI run logging, prompt/model metadata capture, evidence citations, output traceability, reviewer feedback capture and human-in-the-loop controls.
• Build AI evaluation routines for answer quality, retrieval quality, hallucination checks, regression testing, consistency and groundedness.
• Collaborate with backend and DevOps teams to containerize AI services, deploy them securely, monitor usage, track costs and troubleshoot production issues.
• Support responsible AI practices such as prompt injection checks, data leakage prevention, policy-based guardrails and AI output validation.
• Exposure to RAG evaluation tools such as RAGAS, DeepEval, Promptfoo, LangSmith or equivalent frameworks.
• Experience with AI governance, prompt/model registry, AI audit logs, explainability, groundedness checks and human review workflows.