Remote AI Architect & Principal Engineer

EPAM Systems; Atlanta (GA); Remote; USD 140,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts (Healthcare

Short-Term and Long-Term Disability

Life and AD&D Insurance

Job summary

EPAM Systems is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods. You will balance hands-on coding (30–40%) with high-level system architecture, standards, and mentorship across teams.

You will collaborate with US-based Product, Security, Data, and Infrastructure teams to ensure reliable, fast, and secure agentive systems, focusing on multi-agent workflows and low-latency LLM orchestration in production.

Qualifications

• 10+ years of software engineering experience in distributed backend systems.
• 6+ years Python, with FastAPI, AsyncIO, and modern typing practices.
• 3+ years building production systems with LLMs (LangChain, LangGraph, AWS Bedrock, OpenAI).
• Hands-on experience with LangGraph or similar stateful agent frameworks, managing state graphs and loops.
• 3 to 4 years of React and TypeScript experience, streaming APIs with web clients.
• Production AWS experience (EKS/ECS, Lambda, Bedrock, S3, Docker, Terraform/OpenTofu).
• Authentication and security fundamentals, OAuth 2.0, OIDC, secure credential handling.

Responsibilities

• Set architectural direction across multiple AI pods with trade-offs between model capabilities, cost, latency, and complexity.
• Spend roughly a third of your time coding backend AI services and defining integration contracts with frontend teams.
• Design agent workflows with streaming responses and low latency for chat and automated tasks.
• Establish shared standards for MCP servers, tool schemas, and context management.
• Work with security and infrastructure to enforce least-privilege tool execution and secret handling.
• Mentor Staff and Senior engineers through design reviews and technical guidance.

Skills

Python

FastAPI

AsyncIO

LLMs

LangGraph

LangChain

AWS

React

TypeScript

OAuth 2.0

Security

Tools

AWS Bedrock

OpenAI API

Docker

Terraform/OpenTofu

EKS

S3

Job description

EPAM Systems is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods. You will balance hands-on coding (30–40%) with high-level system architecture, standards, and mentorship across teams.

You will collaborate with US-based Product, Security, Data, and Infrastructure teams to ensure reliable, fast, and secure agentive systems, focusing on multi-agent workflows and low-latency LLM orchestration in production.