Solution Architect, Forward Deployed AI

EPAM Systems Inc; Newtown (PA); Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Medical, Dental & Vision

Health Savings Account

FSAs

Short-Term Disability

Life & AD&D Insurance

Employee Assistance Program

LinkedIn Learning

401(k) Matching

Paid Time Off

Paid Holidays

Legal Plan

Identity Theft Protection

Accident Insurance

Employee Discounts

Stock Purchase Plan

Discretionary Bonus

Long-Term Incentive

Job summary

EPAM Systems, Inc. is seeking a Solution Architect to turn AI pilots into secure, scalable production systems, embedded with client teams. You will design LLM, RAG, and agentic solutions, define governance, and prove decisions with working code.

In this remote US role, you will collaborate across business and engineering teams, lead architecture decisions, and publish reusable patterns while ensuring production quality and AI observability. Salary range $150,000–$200,000.

Qualifications

• Experience designing client AI solutions that reached production.
• Strong knowledge of cloud and microservice architectures.
• Familiarity with LLMs, RAG, AI governance, and observability.
• Proficient Python coding to prototype and validate AI implementations.

Responsibilities

• Partner with client teams to resolve requirements and record architecture decisions.
• Design architectures for RAG, agents, orchestration, and MCP integration.
• Build Cloud FinOps cost models linking cost, usage, and value.
• Document AI governance with autonomy limits, tool permissions, and checkpoints.
• Model domain knowledge graphs and apply GraphRAG for improved retrieval.
• Create Python reference implementations and guide pilot-to-prod transitions.

Skills

Solution architecture

Cloud computing

Python coding

AI governance

Stakeholder communication

Tools

MCP integration

APIs

Job description

Turn AI pilots into secure, reliable production systems as a Solution Architect embedded with client business and engineering teams. You will design LLM, RAG, and agentic solutions, define governance and evaluation, and prove decisions with working code, helping enterprises adopt AI responsibly and at scale.

Lead at EPAM, where your expertise guides global change. Collaborate with top talent, influence cutting-edge solutions, and create a legacy in a company that values leadership, innovation, and growth.

Req.#1116590542

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, Model Context Protocol (MCP) tool integration, Identity and Access Management, enterprise integration, LLM security, AI observability, and LLM evaluation
• Build Cloud FinOps cost models that link feature cost, usage, quality, and expected business value
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and testing results, and rollback controls
• Model domain Knowledge Graph slices covering entities, relationships, business constraints, provenance, and owners, applying GraphRAG where relationships improve retrieval
• Build Python reference implementations and technical proofs with Forward Deployed Engineers, then preserve architecture integrity through the pilot-to-production transition under Architecture Governance and publish reusable patterns

Requirements

• Client-facing solution architecture experience with business software or AI solutions that reached production, at either Solution Architect I level (own a bounded design with senior review) or Solution Architect II level (independently lead a complete client AI solution)
• Strong fundamentals in cloud computing architecture, microservice architecture, APIs, data flows, Identity and Access Management, and enterprise integration patterns
• Practical knowledge of LLM applications, Prompt Engineering, RAG, AI agent frameworks, tool calling through MCP, and agent orchestration
• Recent hands-on Python coding to prototype, inspect failures, and validate AI-assisted implementation work
• Experience defining LLM evaluation, AI observability, LLM security controls, and production quality attributes, plus an understanding of AI Governance, including agent permissions, autonomy, human oversight, auditability, and enterprise risk
• Clear architecture documentation and strong communication with business and technical stakeholders, with comfort working on-site amid ambiguity (regulated-industry and Cloud FinOps exposure is a plus)

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
• Paid Holidays - nine (9) total per year
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program
• If otherwise eligible, participation in the discretionary annual bonus program
• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $150,000 - $200,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.