Architect / Principal Software Engineer, AI Solution Engineering

EPAM Systems, Inc.; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off & sick leave

Upskilling & certification courses

LinkedIn Learning access

Global career opportunities

Volunteer opportunities

EPAM Employee Groups

Job summary

EPAM Systems, Inc. seeks an Architect / Principal Software Engineer to guide AI engineering teams while remaining hands-on with core prototyping and reference implementations.

You will shape reliable, secure, low-latency agentic systems and standards across pods. Responsibilities include setting architectural direction, designing multi-agent workflows, building backend AI services, and defining integration contracts with frontend teams.

Qualifications

• 8+ years of software engineering experience designing and operating distributed backend systems.
• 5+ years of Python with FastAPI, AsyncIO, and modern typing practices.
• 2+ years of production experience building LLM-powered systems using LangChain and AWS Bedrock.

Responsibilities

• Set architectural direction across AI pods and decide trade-offs between capability, cost, latency, and operability.
• Design predictable multi-agent workflows and low-latency orchestration services for chat and automated tasks.
• Build backend AI services and reference implementations and define integration contracts with frontend teams.
• Review code and provide technical guidance to raise engineering quality across teams.
• Establish standards for Model Context Protocol servers, tool schemas, and context management practices.
• Partner with security and infrastructure teams to enforce least-privilege execution, tenant isolation, and secret handling.
• Define observability requirements and service-level objectives, including tracing and end-to-end monitoring.

Skills

Distributed backend design

Python (FastAPI, AsyncIO, typing)

LLM systems development

LangChain / AWS Bedrock

LangGraph

Leadership/mentoring

Cross-functional collaboration

Security fundamentals (OAuth 2.0, OIDC

English communication (B2)

Tools

LangChain

AWS Bedrock

LangGraph

OpenSearch

Pinecone

Qdrant

Terraform

Docker

AWS EKS/ECS

S3

Job description

We are seeking an Architect / Principal Software Engineer to guide AI engineering teams while staying hands-on with core prototyping and reference implementations. You will shape reliable, secure, low-latency agentic systems and standards across pods.ResponsibilitiesSet architectural direction across AI pods and decide trade-offs between capability, cost, latency, and operabilityDesign predictable multi-agent workflows and low-latency orchestration services for chat and automated tasksBuild backend AI services and reference implementations and define integration contracts with frontend teamsReview code and provide technical guidance to raise engineering quality across teamsEstablish standards for Model Context Protocol servers, tool schemas, and context management practicesPartner with security and infrastructure teams to enforce least-privilege execution, tenant isolation, and secret handlingDefine observability requirements and service-level objectives, including tracing and end-to-end monitoringRequirements8+ years of software engineering experience designing and operating distributed backend systems5+ years of Python experience with FastAPI, AsyncIO, and modern typing practices2+ years of production experience building LLM-powered systems using tools such as LangChain and AWS BedrockHands-on experience with stateful agent frameworks such as LangGraph including state graphs, loops, and checkpointingProven leadership experience setting technical direction and mentoring senior engineers through design reviewsStrong project collaboration skills partnering with product, security, data, and infrastructure stakeholdersSolid AWS production experience with services such as EKS or ECS, Lambda, S3, Docker, and BedrockStrong REST API design skills including stable integration contracts and streaming response patternsStrong security fundamentals including OAuth 2.0, OIDC, and secure secret handlingClear communication skills with the ability to explain trade-offs on cost, latency, and operational complexityEnglish proficiency: B2 Upper-IntermediateNice to haveModel Context Protocol server implementation experience and tool discovery patternsTerraform experience for production infrastructure automationVector database migration experience from legacy retrieval to OpenSearch, Pinecone, or QdrantVector database design experience for retrieval pipelines and indexing strategiesWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn