Solution Architect, Forward Deployed AI

EPAM Systems; McLean (VA); Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts

Disability Insurance

Life and AD&D Insurance

Employee Assistance Program

LinkedIn learning access

Matched 401(k) Retirement Savings Plan

Paid Time Off

Paid Holidays

Employee Discounts

Job summary

EPAM Systems Inc. is seeking a Solution Architect to turn AI pilots into secure, scalable production systems. You will design LLM, RAG, and agentic solutions, define governance, and prove decisions with working code while aligning with client teams across business and engineering.

You will collaborate with top talent, influence cutting-edge AI solutions, and help enterprises adopt responsible AI at scale, with a focus on architecture governance and measurable business value.

Qualifications

• Production-ready client-facing solution architecture experience with bounded design or independent leadership.
• Strong fundamentals in cloud, microservices, APIs, data flows and enterprise integration.
• Practical knowledge of LLM apps, RAG, agent frameworks, MCP tool calling and agent orchestration.
• Recent hands-on Python coding to prototype, inspect failures, and validate AI work.
• Experience defining LLM evaluation, observability, security controls, and governance for production.

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to record architecture decisions.
• Design end-to-end AI solution architectures covering RAG, agentic workflows and MCP tool integration.
• Build Cloud FinOps cost models linking feature cost, usage, quality, and business value.
• Document AI governance evidence, including autonomy limits, tool permissions, human checkpoints, and rollback controls.
• Model Knowledge Graph slices and apply GraphRAG to improve retrieval.
• Create Python reference implementations and proofs, ensuring pilot-to-prod transition maintains architecture integrity.

Skills

Client-facing architecture

Cloud computing

Microservice architecture

APIs & data flows

IAM & enterprise integration

LLM/RAG/agent frameworks

Python prototyping

AI governance & observability

Tools

MCP tool integration

Forward Deployed Engineers collaboration

Job description

Turn AI pilots into secure, reliable production systems as a Solution Architect embedded with client business and engineering teams. You will design LLM, RAG, and agentic solutions, define governance and evaluation, and prove decisions with working code, helping enterprises adopt AI responsibly and at scale.

Lead at EPAM, where your expertise guides global change. Collaborate with top talent, influence cutting-edge solutions, and create a legacy in a company that values leadership, innovation, and growth.

Req.#1116590542

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, Model Context Protocol (MCP) tool integration, Identity and Access Management, enterprise integration, LLM security, AI observability, and LLM evaluation
• Build Cloud FinOps cost models that link feature cost, usage, quality, and expected business value
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and testing results, and rollback controls
• Model domain Knowledge Graph slices covering entities, relationships, business constraints, provenance, and owners, applying GraphRAG where relationships improve retrieval
• Build Python reference implementations and technical proofs with Forward Deployed Engineers, then preserve architecture integrity through the pilot-to-production transition under Architecture Governance and publish reusable patterns

Requirements

• Client-facing solution architecture experience with business software or AI solutions that reached production, at either Solution Architect I level (own a bounded design with senior review) or Solution Architect II level (independently lead a complete client AI solution)
• Strong fundamentals in cloud computing architecture, microservice architecture, APIs, data flows, Identity and Access Management, and enterprise integration patterns
• Practical knowledge of LLM applications, Prompt Engineering, RAG, AI agent frameworks, tool calling through MCP, and agent orchestration
• Recent hands-on Python coding to prototype, inspect failures, and validate AI-assisted implementation work
• Experience defining LLM evaluation, AI observability, LLM security controls, and production quality attributes, plus an understanding of AI Governance, including agent permissions, autonomy, human oversight, auditability, and enterprise risk
• Clear architecture documentation and strong communication with business and technical stakeholders, with comfort working on-site amid ambiguity (regulated-industry and Cloud FinOps exposure is a plus)

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
• Paid Holidays - nine (9) total per year
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program
• If otherwise eligible, participation in the discretionary annual bonus program
• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $150,000 - $200,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.