Lead Python Developer, Backend

EPAM Systems, Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off & sick leave

Upskilling & certification programs

Global career opportunities

Job summary

EPAM Systems, Inc. is seeking a Lead Python Backend Developer to deliver secure, scalable AI-driven API services and agentic workflows for LLM integration. You will own API contracts, RAG orchestration, and service reliability across distributed systems.

Responsibilities include designing backend APIs, implementing RAG pipelines, and wiring agent tools. You will collaborate with cross-functional teams to ensure security, observability, and robust testing across all backend workflows.

Qualifications

• Proven backend engineering background with 5+ years in microservices and distributed systems.
• High proficiency in Python for performant backend services and cloud-native APIs.
• Hands-on familiarity with AWS, Docker, and ECS/EKS.
• Strong RESTful API design principles and secure coding practices.
• English proficiency at B2 (Upper-Intermediate) level or higher.
• Nice to have production experience with AI SDKs such as OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent.
• Practical exposure to vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systems.
• Hands-on work with LangChain, LlamaIndex, or LangGraph.
• Familiarity with AI evaluation tooling or real-time APM such as LangSmith, Langfuse, or Arize.
• Experience deploying to EKS environments at scale.

Responsibilities

• Design and deliver backend API services plus LLM orchestration layers.
• Implement and operate end-to-end RAG pipelines, including ingestion, chunking, embedding, and retrieval optimization.
• Develop and wire up agent tools using orchestration frameworks.
• Ensure security, privacy, enterprise-grade observability, and test coverage across all backend workflows.
• Drive architecture choices and help shape engineering standards within the pod.
• Collaborate with frontend engineers, data engineers, and infrastructure teams to ship cohesive solutions.
• Own API contracts and end-to-end service reliability, ensuring AI edge cases fail gracefully.
• Integrate LLMs with rigorous systems engineering, including evaluation, observability, fallback handling, and cost awareness.

Skills

Python

Microservices

Distributed systems

REST APIs

Security practices

Auth/authorization

AWS

Docker

ECS/EKS

API design

React

TypeScript

LangChain

LlamaIndex

LangGraph

OpenAI SDK

OpenSearch

Kendra

LangSmith

Arize

AI evaluation tooling

Tools

LangChain

LlamaIndex

LangGraph

OpenAI SDK

OpenSearch

Kendra

LangSmith

Arize

Job description

We are seeking a Lead Python Backend Developer to deliver secure, scalable AI-driven API services and agentic workflows for LLM integration. You will own API contracts, RAG orchestration, and service reliability across distributed systems, partnering with adjacent teams to keep quality high.ResponsibilitiesDesign and deliver backend API services plus LLM orchestration layersImplement and operate end-to-end RAG pipelines, covering document ingestion, chunking, embedding, and retrieval optimizationDevelop and wire up agent tools using orchestration frameworksEnsure security, privacy, enterprise-grade observability, and test coverage across all backend workflowsDrive architecture choices and help shape engineering standards within the podCollaborate with frontend engineers, data engineers, and infrastructure teams to ship cohesive solutionsOwn API contracts and end-to-end service reliability, ensuring AI edge cases fail gracefullyIntegrate LLMs with rigorous systems engineering, including evaluation, observability, fallback handling, and cost awarenessBuild dependable, reusable orchestration frameworks and logic for downstream developer consumptionRequirementsProven backend engineering background with 5+ years of experience in microservices and distributed systemsHigh proficiency in Python for performant backend services and cloud-native APIsHands-on familiarity with AWS, Docker, and ECS/EKSSolid understanding of RESTful APIs and API design principlesStrong foundation in secure coding practices with clear auth/authz fundamentalsEnglish proficiency at B2 (Upper-Intermediate) level or higherNice to haveProduction experience with AI SDKs such as OpenAI, Anthropic/Claude, AWS Bedrock, or equivalentPractical exposure to vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systemsHands-on work with LangChain, LlamaIndex, or LangGraphFamiliarity with AI evaluation tooling or real-time APM such as LangSmith, Langfuse, or ArizeSkills in React and TypeScriptExperience deploying to EKS environments at scaleUnderstanding of agent interoperability patterns (MCP)Knowledge of identity and security domains (IAM, CIAM)Familiarity with secondary languages such as Java, Node.js, or GoWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn