Senior Python AI Engineer - LLM & API Orchestration

EPAM Systems; United States; Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Matching

Paid Time Off

Employee Stock Purchase Program

LinkedIn Learning

Discretionary bonus

LTI Program

Job summary

EPAM Systems is seeking a Lead Python AI Engineer to design and operate AI-powered API services and agentic workflows within a secure, scalable backend architecture. You will connect LLMs with internal systems, vector stores, and external tools, emphasizing reliability, observability, and robust fallback handling.

Responsibilities include end-to-end ownership of API contracts, building reusable orchestration frameworks, and implementing advanced RAG pipelines with document ingestion, embedding,

Qualifications

• 7+ years of backend engineering focused on microservices and distributed systems.
• Strong Python experience for high-performance backend services and cloud-native APIs.
• Secure coding practices and strong authentication/authorization fundamentals.
• Experience with agent frameworks and AI integration in production environments.

Responsibilities

• Own API contracts and service reliability end-to-end.
• Integrate LLMs with robust observability, evaluation, and cost awareness.
• Build reusable orchestration frameworks for downstream developers.
• Develop and optimize RAG pipelines and document ingestion/embedding/retrieval.

Skills

Python

Distributed systems

Backend engineering

Cloud & Infrastructure

Security

AI observability

LangChain

LangGraph

LlamaIndex

OpenAI

AWS Bedrock

Tools

Docker

ECS/EKS

RESTful APIs

Auth/Authz

Kendra

OpenSearch

LangSmith

Langfuse

Arize

Job description

EPAM Systems is seeking a Lead Python AI Engineer to design and operate AI-powered API services and agentic workflows within a secure, scalable backend architecture. You will connect LLMs with internal systems, vector stores, and external tools, emphasizing reliability, observability, and robust fallback handling.

Responsibilities include end-to-end ownership of API contracts, building reusable orchestration frameworks, and implementing advanced RAG pipelines with document ingestion, embedding,