Solution Architect, Forward Deployed AI

EPAM Systems Inc; Chicago (IL); Remote; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health benefits

Flexible work options

LinkedIn Learning access

Job summary

EPAM Systems Inc. is seeking a Solution Architect to translate AI pilots into production-ready, secure, and scalable systems.

You will collaborate with client business and engineering teams to design RAG, agentic workflows, and governance, while proving decisions with working code as part of responsible AI adoption. You will lead architecture decisions, document policies, and guide the pilot-to-production transition, ensuring enterprise-grade security, observability, and cost models are

Qualifications

• :// Must have client-facing solution architecture experience with production-ready AI or enterprise software.
• :
• Proven experience in cloud and microservice architectures and enterprise integration patterns.
• :
• Hands-on Python coding to prototype AI-assisted implementations.

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions.
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, MCP tool integration, IAM, enterprise integration, LLM security, observability, and evaluation.
• Build Cloud FinOps cost models linking feature cost, usage, quality, and business value.
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and testing results, and rollback controls.
• Model domain Knowledge Graph slices covering entities, relationships, constraints, provenance, and owners, applying GraphRAG for retrieval improvements.
• Create Python reference implementations and proofs with Forward Deployed Engineers, maintaining architecture integrity through pilot-to-production.

Skills

Client-facing architecture

Cloud computing

Microservice architecture

APIs

Identity & Access Management

Enterprise integration

Python coding

Governance & risk

LLM knowledge

Tools

MCP tool integration

LLM tooling

Job description

Turn AI pilots into secure, reliable production systems as a Solution Architect embedded with client business and engineering teams. You will design LLM, RAG, and agentic solutions, define governance and evaluation, and prove decisions with working code, helping enterprises adopt AI responsibly and at scale.

Lead at EPAM, where your expertise guides global change. Collaborate with top talent, influence cutting-edge solutions, and create a legacy in a company that values leadership, innovation, and growth.

Req.#1116590542

Responsibilities

• Partner with client business, product, engineering, security, and operations teams to resolve requirements and record architecture decisions
• Design end-to-end AI solution architectures covering RAG, agentic workflows and orchestration, Model Context Protocol (MCP) tool integration, Identity and Access Management, enterprise integration, LLM security, AI observability, and LLM evaluation
• Build Cloud FinOps cost models that link feature cost, usage, quality, and expected business value
• Document AI governance evidence for each agent, including autonomy limits, tool permissions, human checkpoints, evaluation and testing results, and rollback controls
• Model domain Knowledge Graph slices covering entities, relationships, business constraints, provenance, and owners, applying GraphRAG where relationships improve retrieval
• Build Python reference implementations and technical proofs with Forward Deployed Engineers, then preserve architecture integrity through the pilot-to-production transition under Architecture Governance and publish reusable patterns

Requirements

• Client-facing solution architecture experience with business software or AI solutions that reached production, at either Solution Architect I level (own a bounded design with senior review) or Solution Architect II level (independently lead a complete client AI solution)
• Strong fundamentals in cloud computing architecture, microservice architecture, APIs, data flows, Identity and Access Management, and enterprise integration patterns
• Practical knowledge of LLM applications, Prompt Engineering, RAG, AI agent frameworks, tool calling through MCP, and agent orchestration
• Recent hands-on Python coding to prototype, inspect failures, and validate AI-assisted implementation work
• Experience defining LLM evaluation, AI observability, LLM security controls, and production quality attributes, plus an understanding of AI Governance, including agent permissions, autonomy, human oversight, auditability, and enterprise risk
• Clear architecture documentation and strong communication with business and technical stakeholders, with comfort working on-site amid ambiguity (regulated-industry and Cloud FinOps exposure is a plus)

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
• Paid Holidays - nine (9) total per year
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program
• If otherwise eligible, participation in the discretionary annual bonus program
• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $150,000 - $200,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.