Solution Architect, Forward Deployed AI

EPAM Systems; San Jose (CA); Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts (Healthcare

Disability Insurance

Life and AD&D Insurance

Employee Assistance Program

LinkedIn learning solutions

Matched 401(k) Retirement Savings Plan

Paid Time Off

Paid Holidays

Legal Plan

Identity Theft Protection

Accident Insurance

Employee Discounts

Pet Insurance

Employee Stock Purchase Program

Discretionary bonus program

Discretionary Long-Term Incentive (LTI

Job summary

EPAM Systems, Inc. is seeking a Solution Architect embedded with client teams to design secure, scalable AI systems using LLMs, RAG, and agentic workflows. You will govern architecture decisions, prove concepts with working code, and help customers adopt AI responsibly and at scale.

The role emphasizes collaboration across business and engineering, governance, and enterprise integration, with a focus on producing reusable patterns and production-grade solutions.

Qualifications

• Client-facing solution architecture experience with production AI solutions.
• Strong cloud and microservice fundamentals in enterprise environments.
• Experience with LLMs, RAG, and AI agent frameworks in production settings.
• Hands-on Python coding for prototyping and validation.

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, MCP tool integration, IAM, enterprise integration, LLM security, observability, and evaluation
• Build Cloud FinOps cost models linking feature cost, usage, quality, and business value
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and rollback controls
• Model domain Knowledge Graph slices covering entities, relationships, provenance, and owners, applying GraphRAG to improve retrieval
• Build Python reference implementations and proofs with Forward Deployed Engineers and ensure pilot-to-production transition under Architecture Governance

Skills

Solution architecture

Cloud architecture

Microservices

APIs

IAM

Enterprise integration

LLM applications

Prompt engineering

RAG

Agent frameworks

MCP

Agent orchestration

Python coding

LLM evaluation

AI observability

LLM security

Governance

Auditability

Documentation

Stakeholder communication

Tools

Python

MCP

GraphRAG

Job description

Turn AI pilots into secure, reliable production systems as a Solution Architect embedded with client business and engineering teams. You will design LLM, RAG, and agentic solutions, define governance and evaluation, and prove decisions with working code, helping enterprises adopt AI responsibly and at scale.

Lead at EPAM, where your expertise guides global change. Collaborate with top talent, influence cutting-edge solutions, and create a legacy in a company that values leadership, innovation, and growth.

Req.#1116590542

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, Model Context Protocol (MCP) tool integration, Identity and Access Management, enterprise integration, LLM security, AI observability, and LLM evaluation
• Build Cloud FinOps cost models that link feature cost, usage, quality, and expected business value
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and testing results, and rollback controls
• Model domain Knowledge Graph slices covering entities, relationships, business constraints, provenance, and owners, applying GraphRAG where relationships improve retrieval
• Build Python reference implementations and technical proofs with Forward Deployed Engineers, then preserve architecture integrity through the pilot-to-production transition under Architecture Governance and publish reusable patterns

Requirements

• Client-facing solution architecture experience with business software or AI solutions that reached production, at either Solution Architect I level (own a bounded design with senior review) or Solution Architect II level (independently lead a complete client AI solution)
• Strong fundamentals in cloud computing architecture, microservice architecture, APIs, data flows, Identity and Access Management, and enterprise integration patterns
• Practical knowledge of LLM applications, Prompt Engineering, RAG, AI agent frameworks, tool calling through MCP, and agent orchestration
• Recent hands-on Python coding to prototype, inspect failures, and validate AI-assisted implementation work
• Experience defining LLM evaluation, AI observability, LLM security controls, and production quality attributes, plus an understanding of AI Governance, including agent permissions, autonomy, human oversight, auditability, and enterprise risk
• Clear architecture documentation and strong communication with business and technical stakeholders, with comfort working on-site amid ambiguity (regulated-industry and Cloud FinOps exposure is a plus)

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
• Paid Holidays - nine (9) total per year
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program
• If otherwise eligible, participation in the discretionary annual bonus program
• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $150,000 - $200,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.