Architect & Principal AI Engineer: Lead Secure, Low-Latency

EPAM Systems, Inc.; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off & sick leave

Upskilling & certification courses

LinkedIn Learning access

Global career opportunities

Volunteer opportunities

EPAM Employee Groups

Job summary

EPAM Systems, Inc. seeks an Architect / Principal Software Engineer to guide AI engineering teams while remaining hands-on with core prototyping and reference implementations.

You will shape reliable, secure, low-latency agentic systems and standards across pods. Responsibilities include setting architectural direction, designing multi-agent workflows, building backend AI services, and defining integration contracts with frontend teams.

Qualifications

• 8+ years of software engineering experience designing and operating distributed backend systems.
• 5+ years of Python with FastAPI, AsyncIO, and modern typing practices.
• 2+ years of production experience building LLM-powered systems using LangChain and AWS Bedrock.

Responsibilities

• Set architectural direction across AI pods and decide trade-offs between capability, cost, latency, and operability.
• Design predictable multi-agent workflows and low-latency orchestration services for chat and automated tasks.
• Build backend AI services and reference implementations and define integration contracts with frontend teams.
• Review code and provide technical guidance to raise engineering quality across teams.
• Establish standards for Model Context Protocol servers, tool schemas, and context management practices.
• Partner with security and infrastructure teams to enforce least-privilege execution, tenant isolation, and secret handling.
• Define observability requirements and service-level objectives, including tracing and end-to-end monitoring.

Skills

Distributed backend design

Python (FastAPI, AsyncIO, typing)

LLM systems development

LangChain / AWS Bedrock

LangGraph

Leadership/mentoring

Cross-functional collaboration

Security fundamentals (OAuth 2.0, OIDC

English communication (B2)

Tools

LangChain

AWS Bedrock

LangGraph

OpenSearch

Pinecone

Qdrant

Terraform

Docker

AWS EKS/ECS

S3

Job description

EPAM Systems, Inc. seeks an Architect / Principal Software Engineer to guide AI engineering teams while remaining hands-on with core prototyping and reference implementations.

You will shape reliable, secure, low-latency agentic systems and standards across pods. Responsibilities include setting architectural direction, designing multi-agent workflows, building backend AI services, and defining integration contracts with frontend teams.