Remote AI Architect & Principal Engineer

EPAM Systems Inc; Los Angeles (CA); Remote; USD 140,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Health Savings Account

Flexible Spending Accounts (Healthcare

Short-Term and Long-Term Disability

Life and AD&D Insurance

Employee Assistance Program

LinkedIn Learning access

401(k) Retirement Savings Plan

Paid Time Off

Paid Holidays

Legal Plan and Identity Theft

Pet Insurance

Employee Stock Purchase Program

Annual bonus program

Long-Term Incentive Program

Job summary

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods.

You will split time between hands-on engineering (about 30% to 40% prototyping core workflows and reviewing code) and higher-level system architecture, standards, and mentorship across teams. You will collaborate with US-based Product, Security, Data, and Infrastructure teams to ensure reliable, fast, and secure agentic systems.

Qualifications

• 10+ years of software engineering experience, with distributed backend systems.
• 6+ years of Python experience with FastAPI/AsyncIO.
• 3+ years building production systems with LLMs (LangChain, LangGraph, OpenAI, AWS Bedrock).
• Hands-on with LangGraph or similar stateful agent frameworks, managing state graphs and loops.
• 3–4 years of React and TypeScript experience, review UI code and streaming APIs.
• Production AWS experience: EKS/ECS, Lambda, Bedrock, S3, Docker, Terraform/OpenTofu.
• OAuth 2.0/OIDC security fundamentals.

Responsibilities

• Set architectural direction across multiple AI pods, balancing model capabilities, cost, latency, and complexity.
• Spend ~1/3 of time coding back-end AI services and defining integration contracts with frontend teams.
• Design agent workflows with streaming responses and low latency for chat/automated tasks.
• Establish shared standards for Model Context Protocol servers, tool schemas and context management.
• Enforce least-privilege tool execution, tenant isolation, and secret handling with security teams.
• Define observability and SLIs, including tracing with LangSmith or Arize Phoenix.
• Mentor Staff and Senior engineers through design reviews and guidance.

Skills

System architecture

Distributed backend design

Mentoring Staff

Code review

Security fundamentals

Tools

LangChain

LangGraph

AWS Bedrock

OpenAI APIs

Docker

Terraform/OpenTofu

Job description

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods.

You will split time between hands-on engineering (about 30% to 40% prototyping core workflows and reviewing code) and higher-level system architecture, standards, and mentorship across teams. You will collaborate with US-based Product, Security, Data, and Infrastructure teams to ensure reliable, fast, and secure agentic systems.