Senior Software Engineer - Python with GenAI, LLM

EPAM Systems India Pvt Ltd; Bengaluru, Hyderabad, Gurugram District, Pune District; On-site; INR 3,000,000 - 5,000,000; Full time

Job summary

EPAM Systems India Pvt Ltd is seeking an experienced Senior Software Engineer with Python and GenAI expertise to design and build production-grade Generative AI solutions. You will work on agentic workflows, multi-agent systems, and enterprise AI applications, integrating LLMs with enterprise systems and APIs.

You will design scalable AI applications, orchestrate agents using LangChain, LangGraph, and other frameworks, and collaborate with product, data, and design teams to deliver impactful

Qualifications

• 5-7 years of software engineering experience
• Hands-on with Generative AI and LLM technologies
• Strong Python background and production-grade app development
• Experience with multiple agentic AI frameworks
• Experience with cloud AI platforms such as Azure OpenAI, AWS Bedrock, or Google Vertex AI/ADK
• Backend skills: REST/gRPC APIs, asynchronous programming, Docker, FastAPI or Flask
• Familiarity with RAG, agentic RAG, tool calling, planning & reflection loops
• Prompt engineering, LLM orchestration, and evaluation techniques

Responsibilities

• Design, architect, and develop scalable Generative AI applications and agentic solutions
• Build and orchestrate AI agents using frameworks like LangChain, LangGraph, Google ADK, CrewAI, AutoGen, or Microsoft Copilot Studio
• Develop and maintain backend services, APIs, microservices, and data pipelines
• Implement advanced AI patterns including RAG, Agentic RAG, tool/function calling, planning & reflection loops
• Engineer and optimize prompts, system instructions, and agent workflows
• Integrate LLMs with enterprise systems, APIs, vector databases, and knowledge repositories
• Monitor and improve model/agent performance using observability tools and user feedback
• Collaborate with Product, Engineering, Data, and Design teams to deliver AI solutions
• Stay current with AI technologies and contribute innovative ideas
• Document architectures and design decisions for knowledge sharing

Skills

Strong problem-solving

System design

Cross-functional collaboration

Effective communication

Tools

Python

Docker

FastAPI/Flask

REST APIs

gRPC

LangChain/LangGraph

Google ADK/CrewAI/AutoGen

Azure/AWS/Vertex AI

Pinecone/Weaviate/ChromaDB/Qdrant

Job description

# Senior Software Engineer - Python with GenAI, LLMOffice in Bangalore, Hyderabad, Gurgaon, PunePython.AI& othersSenior Software Engineer - Python with GenAI, LLMSenior Software Engineer (Python with LMM/GenAI)Senior Software Engineer - Python with GenAI, LLMWe are seeking an experienced **AI Engineer** to design and build production-grade Generative AI solutions with a strong focus on agentic workflows, multi-agent systems, and enterprise AI applications. The ideal candidate combines strong software engineering fundamentals with hands-on expertise in LLMs, RAG architectures, and AI agent frameworks.Responsibilities* Design, architect, and develop scalable Generative AI applications and agentic solutions for real-world business use cases* Build and orchestrate AI agents using frameworks such as LangChain, LangGraph, Google ADK, CrewAI, AutoGen, Microsoft Copilot Studio, or similar technologies* Develop and maintain backend services, APIs, microservices, and data pipelines that power AI-driven products* Implement advanced AI patterns including RAG, Agentic RAG, tool/function calling, planning & reflection loops, and human-in-the-loop workflows* Engineer and optimize prompts, system instructions, and agent workflows to improve reliability, accuracy, and user experience* Integrate LLMs with enterprise systems, third-party APIs, vector databases, and knowledge repositories* Monitor, evaluate, and continuously improve model and agent performance using observability tools, metrics, and user feedback* Collaborate closely with Product, Engineering, Data, and Design teams to deliver impactful AI solutions* Stay current with emerging AI technologies, frameworks, and best practices, contributing innovative ideas to the team* Document architectures, design decisions, and reusable solution patterns while supporting knowledge sharing across teamsRequirements* 5-7 years of experience in software engineering* Hands-on experience building applications using Generative AI and LLM technologies* Strong proficiency in Python and experience developing production-ready applications* Hands-on experience with at least two agentic AI frameworks such as LangChain, LangGraph, Google ADK, CrewAI, AutoGen, or Microsoft Copilot extensibility* Experience with cloud AI platforms including Azure OpenAI, AWS Bedrock, or Google Vertex AI/ADK* Strong backend development skills, including REST/gRPC APIs, asynchronous programming, Docker, and frameworks such as FastAPI or Flask* Solid understanding of leading LLMs including OpenAI GPT models, Anthropic Claude, Google Gemini, and open-source alternatives* Practical experience building RAG solutions using vector databases such as Pinecone, Weaviate, ChromaDB, or Qdrant* Expertise in prompt engineering, LLM orchestration, structured outputs, guardrails, ReAct patterns, and evaluation techniques* Strong problem-solving, system design, and architectural decision-making skills* Excellent communication skills with the ability to collaborate effectively across global teams