Principal AI Architect & Engineer

EPAM Systems Inc; Philadelphia (Philadelphia County); Remote; USD 140,000 - 165,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Matched 401(k) Retirement Savings Plan

Paid Time Off

Paid Holidays

Employee Discounts

Employee Stock Purchase Program

Job summary

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of their AI Engineering pods. You will split time between hands-on coding (30–40%) and higher-level system architecture, mentoring, and setting technical standards.

You will collaborate with US-based Product, Security, Data, and Infrastructure teams to design predictable multi-agent workflows, low-latency LLM orchestration, and robust retrieval pipelines for production.

Qualifications

• 10+ years of software engineering experience in distributed backend systems.
• 6+ years of Python experience with FastAPI, AsyncIO and modern typing.
• 3+ years building production systems with LLMs (LangChain, LangGraph, AWS Bedrock, OpenAI APIs).
• Hands-on experience with stateful agent frameworks and managing loops/state graphs.

Responsibilities

• Set architectural direction across multiple AI pods, balancing model capabilities, cost, latency and complexity.
• Spend ~1/3 of time coding backend AI services and integrating front-end contracts.
• Design agent workflows with streaming responses and low-latency interactions for chat tasks.
• Establish standards for MCP servers, tool schemas, and context management.
• Work with Security and Infrastructure to enforce least-privilege execution and secret handling.
• Define observability and SLOs; enable tracing with LangSmith or Arize Phoenix.
• Mentor Staff and Senior engineers through design reviews and guidance.

Skills

Python

FastAPI

AsyncIO

Typing

LLMs

LangChain

LangGraph

AWS

Security

Mentoring

Code Reviews

Tools

LangGraph

LangChain

AWS Bedrock

OpenAI API

PyTorch

Docker

Terraform/OpenTofu

S3

Job description

EPAM Systems, Inc. is seeking an Architect / Principal Software Engineer to lead the technical direction of their AI Engineering pods. You will split time between hands-on coding (30–40%) and higher-level system architecture, mentoring, and setting technical standards.

You will collaborate with US-based Product, Security, Data, and Infrastructure teams to design predictable multi-agent workflows, low-latency LLM orchestration, and robust retrieval pipelines for production.