Senior Software Engineer – Python with GenAI, LLM

EPAM Systems Inc

Hyderabad, Gurugram District, Bengaluru

On-site

INR 2,000,000 - 3,600,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EPAM Systems Inc. seeks an experienced AI Engineer to design and build production-grade Generative AI solutions with a focus on agentic workflows and multi-agent systems.

You will combine software engineering fundamentals with hands-on expertise in LLMs, RAG architectures, and AI agent frameworks. Responsibilities include designing scalable AI applications, orchestrating AI agents, building back-end services and data pipelines, and collaborating with Product, Engineering, and Design teams to

Qualifications

  • 5-7 years of software engineering experience.
  • Hands-on experience building applications with Generative AI and LLMs.
  • Strong Python proficiency for production-grade apps.
  • Experience with at least two agentic AI frameworks (LangChain, LangGraph, Google ADK, CrewAI, AutoGen, Copilot Studio).
  • Experience with cloud AI platforms (Azure OpenAI, AWS Bedrock, Google Vertex AI/ADK).
  • Strong backend skills: REST/gRPC APIs, async programming, Docker, FastAPI/Flask.
  • Knowledge of leading LLMs (OpenAI GPT, Claude, Gemini).
  • Experience with vector DBs (Pinecone, Weaviate, ChromaDB, Qdrant).
  • Expertise in prompt engineering, LLM orchestration, and ReAct patterns.
  • Strong problem-solving and architectural decision-making abilities.
  • Excellent cross-team communication.

Responsibilities

  • Design and build scalable Generative AI applications and agentic solutions for real-world use cases.
  • Orchestrate AI agents using LangChain, LangGraph, and other frameworks.
  • Develop backend services, APIs, and data pipelines powering AI-driven products.
  • Implement RAG, agentic RAG, tool calling, planning and reflection loops.
  • Optimize prompts, system instructions, and agent workflows for reliability and UX.
  • Integrate LLMs with enterprise systems and third-party APIs.
  • Monitor model and agent performance with observability tools and feedback.
  • Collaborate with Product, Engineering, Data, and Design teams to deliver AI solutions.
  • Stay updated with emergent AI technologies and contribute ideas.
  • Document architectures and reusable patterns for knowledge sharing.

Skills

Generative AI
LLM integration
Python
API design
REST/gRPC
Microservices
Prompt engineering
System design
Communication

Tools

LangChain
LangGraph
Google ADK
CrewAI
AutoGen
Microsoft Copilot Studio
Docker
FastAPI

Job description

We are seeking an experienced AI Engineer to design and build production-grade Generative AI solutions with a strong focus on agentic workflows, multi-agent systems, and enterprise AI applications. The ideal candidate combines strong software engineering fundamentals with hands‑on expertise in LLMs, RAG architectures, and AI agent frameworks.

Responsibilities
  • Design, architect, and develop scalable Generative AI applications and agentic solutions for real‑world business use cases
  • Build and orchestrate AI agents using frameworks such as LangChain, LangGraph, Google ADK, CrewAI, AutoGen, Microsoft Copilot Studio, or similar technologies
  • Develop and maintain backend services, APIs, microservices, and data pipelines that power AI‑driven products
  • Implement advanced AI patterns including RAG, Agentic RAG, tool/function calling, planning & reflection loops, and human‑in‑the‑loop workflows
  • Engineer and optimize prompts, system instructions, and agent workflows to improve reliability, accuracy, and user experience
  • Integrate LLMs with enterprise systems, third‑party APIs, vector databases, and knowledge repositories
  • Monitor, evaluate, and continuously improve model and agent performance using observability tools, metrics, and user feedback
  • Collaborate closely with Product, Engineering, Data, and Design teams to deliver impactful AI solutions
  • Stay current with emerging AI technologies, frameworks, and best practices, contributing innovative ideas to the team
  • Document architectures, design decisions, and reusable solution patterns while supporting knowledge sharing across teams
Requirements
  • 5-7 years of experience in software engineering
  • Hands‑on experience building applications using Generative AI and LLM technologies
  • Strong proficiency in Python and experience developing production‑ready applications
  • Hands‑on experience with at least two agentic AI frameworks such as LangChain, LangGraph, Google ADK, CrewAI, AutoGen, or Microsoft Copilot extensibility
  • Experience with cloud AI platforms including Azure OpenAI, AWS Bedrock, or Google Vertex AI/ADK
  • Strong backend development skills, including REST/gRPC APIs, asynchronous programming, Docker, and frameworks such as FastAPI or Flask
  • Solid understanding of leading LLMs including OpenAI GPT models, Anthropic Claude, Google Gemini, and open‑source alternatives
  • Practical experience building RAG solutions using vector databases such as Pinecone, Weaviate, ChromaDB, or Qdrant
  • Expertise in prompt engineering, LLM orchestration, structured outputs, guardrails, ReAct patterns, and evaluation techniques
  • Strong problem‑solving, system design, and architectural decision‑making skills
  • Excellent communication skills with the ability to collaborate effectively across global teams
Location - Bangalore, Hyderabad, Gurgaon, Pune
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - Python with GenAI, LLM
Senior Software Engineer - Python with GenAI, LLM

EPAM Systems Inc • Hyderabad, Pune District, Bengaluru

On-site
INR 1,200,000 - 2,400,000
Senior Software Engineer (Python
Senior Software Engineer (Python

EPAM Systems Inc • Coimbatore District

On-site
INR 1,500,000 - 2,100,000
Senior Software Engineer - Python
Senior Software Engineer - Python

EPAM Systems Inc • Hyderabad

On-site
INR 2,400,000 - 4,200,000
Senior Software Engineer - Python
Senior Software Engineer - Python

EPAM Systems Inc • Maharashtra

On-site
INR 1,500,000 - 2,400,000
Senior Software Engineer (Python
Senior Software Engineer (Python

EPAM Systems Inc • Chennai District

On-site
INR 1,500,000 - 4,000,000
Lead Software Engineer (Python, GenAI, LLM)
Lead Software Engineer (Python, GenAI, LLM)

EPAM Systems Inc • Gurugram District

On-site
INR 3,000,000 - 5,500,000
Lead Software Engineer (Python, GenAI, LLM)
Lead Software Engineer (Python, GenAI, LLM)

EPAM Systems Inc • Bengaluru

On-site
INR 3,800,000 - 6,000,000
Lead Software Engineer (Python, GenAI, LLM)
Lead Software Engineer (Python, GenAI, LLM)

EPAM Systems Inc • Maharashtra

On-site
INR 1,200,000 - 2,500,000
Lead Software Engineer (Python, GenAI, LLM)
Lead Software Engineer (Python, GenAI, LLM)

EPAM Systems Inc • Chennai District

On-site
INR 3,500,000 - 6,500,000
Senior Software Engineer - Python with GenAI, LLM
Senior Software Engineer - Python with GenAI, LLM

EPAM Systems India Pvt Ltd • Bengaluru, Hyderabad, Gurugram District, Pune District

On-site
INR 3,000,000 - 5,000,000