Remote AI Systems Architect & Principal Engineer

EPAM Systems Inc; Newtown (PA); Remote; USD 140,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

401(k) Retirement Savings Plan

Paid Time Off

Job summary

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods.

You will balance hands-on coding (30–40%) with high‑level system architecture, standards, and mentorship across teams to deliver reliable, low‑latency agentic workflows. You will collaborate with product, security, data, and infrastructure to design scalable backends, streaming agent workflows, and production‑ready retrieval pipelines, while enforcing security,

Qualifications

• 10+ years software engineering experience, designing, scaling, and operating distributed backend systems.
• 6+ years Python experience, especially with FastAPI, AsyncIO, and modern typing; Python is primary language.
• 3+ years building production systems with LLMs (LangChain, LangGraph, AWS Bedrock, Claude, or OpenAI APIs).
• 3–4 years React and TypeScript experience, reviewing UI code and frontend state for streaming APIs.

Responsibilities

• Set architectural direction across multiple AI pods, balancing model capabilities, cost, latency, and complexity.
• Spend ~1/3 of time coding backend AI services and defining integration contracts with frontend teams.
• Design agent workflows with streaming responses and low-latency chat/automated tasks.
• Establish shared standards for MCP servers, tool schemas, and context management.
• Enforce security, tenant isolation, secret handling, and least-privilege in agent loops.
• Define observability and SLA requirements.

Skills

Python

React/TypeScript

LLM experience

Distributed backend

Tools

LangGraph

LangChain

AWS Bedrock

OpenAI APIs

Okta Security

EKS/ECS

Terraform/OpenTofu

Job description

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of our AI Engineering pods.

You will balance hands-on coding (30–40%) with high‑level system architecture, standards, and mentorship across teams to deliver reliable, low‑latency agentic workflows. You will collaborate with product, security, data, and infrastructure to design scalable backends, streaming agent workflows, and production‑ready retrieval pipelines, while enforcing security,