AI Architect & Principal Backend Engineer

EPAM Systems, Inc.

United States

Remote

USD 150,000 - 190,000

Full time

5 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Healthcare benefits

Paid time off

Upskilling & certification courses

LinkedIn Learning access

Job summary

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to define technical direction across AI engineering pods, building production-grade agentic systems and ensuring reliability, speed, and security.

This hands-on role balances architecture with mentorship, requiring deep expertise in Python, FastAPI, LangChain, and AWS, and involves drafting standards, design reviews, and guiding cross-functional teams.

Qualifications

10+ years of software engineering experience building distributed backend systems.
6+ years Python experience with FastAPI, AsyncIO, and modern typing.
3+ years production LLM systems experience using LangChain and related agent frameworks.
Hands-on solution architecture balancing cost, latency and operability.
Strong AWS experience with container and serverless services.
Solid security fundamentals including OAuth 2.0, OIDC and secret handling.
Excellent code review and mentorship for senior engineers.
Upper-Intermediate English proficiency.

Responsibilities

Set architectural direction across multiple AI pods and document trade-offs.
Design predictable multi-agent workflows with streaming responses and low latency.
Build backend AI services and reference implementations, coding 30–40% of the time.
Define orchestration patterns and integration contracts with frontend teams.
Establish standards for Model Context Protocol servers, tool schemas, and context management.
Mentor senior engineers through design reviews and guidance.