Remote Lead Python AI Engineer - Scalable LLM/API Systems

EPAM Systems; San Jose (CA); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts (Healthcare

Short-Term and Long-Term Disability

Life and AD&D Insurance

Employee Assistance Program

LinkedIn Learning

401(k) Matching

Paid Time Off

Paid Holidays

Legal Plan

Job summary

EPAM Systems is seeking a Lead Python AI Engineer to build robust, secure API services and agentic workflows. You will bridge traditional backends with LLMs, vector stores, and external tools via orchestration frameworks.

We value production-grade AI integration, resilient APIs, and thorough observability. Bring 7+ years in backend engineering, cloud APIs, and secure coding to this remote role with EPAM.

Qualifications

• 7+ years of backend engineering with microservices and distributed systems
• AWS, Docker, ECS/EKS, and RESTful APIs
• Secure coding practices and auth/authz fundamentals
• Hands-on with LangChain, LlamaIndex, or LangGraph
• 1–2+ years integrating AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock)
• Familiarity with AI evaluation tooling or real-time APM (LangSmith, Langfuse, Arize)
• Experience with vector databases and advanced embedding/retrieval systems

Responsibilities

• Own API contracts and service reliability end-to-end
• Integrate LLMs with strong engineering foundations and observability
• Build reusable orchestration frameworks for downstream developers
• Design and build scalable backend API services and LLM orchestration layers
• Develop and optimize RAG pipelines for ingestion, embedding and retrieval
• Connect agent tools using LangChain, LangGraph, and MCP
• Ensure security, privacy, observability, and test coverage across workflows
• Contribute to architecture decisions and engineering standards
• Collaborate with frontend, data, and infrastructure teams

Skills

Backend engineering

Python

Distributed systems

Security best practices

AI systems integration

Observability

RAG pipelines

Tools

LangChain

LangGraph

LlamaIndex

OpenAI

Anthropic/Claude

AWS Bedrock

Job description

EPAM Systems is seeking a Lead Python AI Engineer to build robust, secure API services and agentic workflows. You will bridge traditional backends with LLMs, vector stores, and external tools via orchestration frameworks.

We value production-grade AI integration, resilient APIs, and thorough observability. Bring 7+ years in backend engineering, cloud APIs, and secure coding to this remote role with EPAM.