Remote AI Architect & Principal Software Engineer

EPAM Systems Inc; Conshohocken (Montgomery County); Remote; USD 140,000 - 165,000; Full time

Benefits offered by this job

Health insurance

401(k) matching plan

Paid time off

Job summary

EPAM Systems, Inc. is seeking an Architect/Principal Software Engineer to guide AI engineering pods' technical direction, balancing prototyping work with high‑level system architecture and mentorship.

You will design multi‑agent workflows and low‑latency LLM orchestration, collaborating with security and data teams to ensure reliability, speed, and security across production pipelines.

Qualifications

• 10+ years of software engineering experience designing, scaling, and operating distributed backend systems.
• 6+ years of Python experience with FastAPI, AsyncIO, and modern typing practices.
• 3+ years building production systems with LLMs, including LangChain, LangGraph, AWS Bedrock, Anthropic Claude, or OpenAI APIs.
• Hands-on experience with LangGraph or similar stateful agent frameworks, managing state graphs and loops.
• 3 to 4 years of React and TypeScript experience, reviewing UI code and frontend state.
• Production AWS experience including EKS/ECS, Lambda, Bedrock, S3, Docker, Terraform/OpenTofu.
• Authentication and security fundamentals (OAuth 2.0, OIDC, credential handling).

Responsibilities

• Set architectural direction across multiple AI pods, balancing model capabilities, cost, latency, and operational complexity.
• Spend roughly a third of your time in code: writing backend AI services, building orchestration patterns, and defining integration contracts with frontend teams.
• Design agent workflows with streaming responses, predictable error handling, and low latency for chat and automated tasks.
• Establish shared standards for Model Context Protocol (MCP) servers, tool schemas, and context management.
• Work with security and infrastructure teams to enforce least-privilege tool execution, tenant isolation, and secret handling.
• Define observability requirements and SLAs, including tracing with tools like LangSmith or Arize Phoenix.
• Mentor Staff and Senior engineers through direct design reviews and technical guidance.

Skills

Software architecture

Python

LLMs production

LangGraph

React/TypeScript

AWS (EKS/ECS/Lambda/S3)

Security (OAuth 2.0/OIDC)

Tools

LangChain

LangGraph

AWS Bedrock

OpenAI APIs

Docker

Terraform/OpenTofu

Job description

EPAM Systems, Inc. is seeking an Architect/Principal Software Engineer to guide AI engineering pods' technical direction, balancing prototyping work with high‑level system architecture and mentorship.

You will design multi‑agent workflows and low‑latency LLM orchestration, collaborating with security and data teams to ensure reliability, speed, and security across production pipelines.