Lead Python Backend Engineer – AI API & Orchestration

EPAM Systems, Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off & sick leave

Upskilling & certification programs

Global career opportunities

Job summary

EPAM Systems, Inc. is seeking a Lead Python Backend Developer to deliver secure, scalable AI-driven API services and agentic workflows for LLM integration. You will own API contracts, RAG orchestration, and service reliability across distributed systems.

Responsibilities include designing backend APIs, implementing RAG pipelines, and wiring agent tools. You will collaborate with cross-functional teams to ensure security, observability, and robust testing across all backend workflows.

Qualifications

• Proven backend engineering background with 5+ years in microservices and distributed systems.
• High proficiency in Python for performant backend services and cloud-native APIs.
• Hands-on familiarity with AWS, Docker, and ECS/EKS.
• Strong RESTful API design principles and secure coding practices.
• English proficiency at B2 (Upper-Intermediate) level or higher.
• Nice to have production experience with AI SDKs such as OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent.
• Practical exposure to vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systems.
• Hands-on work with LangChain, LlamaIndex, or LangGraph.
• Familiarity with AI evaluation tooling or real-time APM such as LangSmith, Langfuse, or Arize.
• Experience deploying to EKS environments at scale.

Responsibilities

• Design and deliver backend API services plus LLM orchestration layers.
• Implement and operate end-to-end RAG pipelines, including ingestion, chunking, embedding, and retrieval optimization.
• Develop and wire up agent tools using orchestration frameworks.
• Ensure security, privacy, enterprise-grade observability, and test coverage across all backend workflows.
• Drive architecture choices and help shape engineering standards within the pod.
• Collaborate with frontend engineers, data engineers, and infrastructure teams to ship cohesive solutions.
• Own API contracts and end-to-end service reliability, ensuring AI edge cases fail gracefully.
• Integrate LLMs with rigorous systems engineering, including evaluation, observability, fallback handling, and cost awareness.

Skills

Python

Microservices

Distributed systems

REST APIs

Security practices

Auth/authorization

AWS

Docker

ECS/EKS

API design

React

TypeScript

LangChain

LlamaIndex

LangGraph

OpenAI SDK

OpenSearch

Kendra

LangSmith

Arize

AI evaluation tooling

Tools

LangChain

LlamaIndex

LangGraph

OpenAI SDK

OpenSearch

Kendra

LangSmith

Arize

Job description

EPAM Systems, Inc. is seeking a Lead Python Backend Developer to deliver secure, scalable AI-driven API services and agentic workflows for LLM integration. You will own API contracts, RAG orchestration, and service reliability across distributed systems.

Responsibilities include designing backend APIs, implementing RAG pipelines, and wiring agent tools. You will collaborate with cross-functional teams to ensure security, observability, and robust testing across all backend workflows.