Generative AI Systems Architect

EPAM Systems; Polska; Hybrid; PLN 220,000 - 360,000; Full time

Benefits offered by this job

Hybrid work

Remote within Poland

Work abroad up to 60 days annually

Relocation opportunities

Stock Purchase Plan 15% discount

Health insurance

Multisport

Vouchers

Job summary

EPAM Systems seeks a Generative AI Platforms Architect to define the enterprise GenAI platform across multiple clouds and to craft reference architectures, guardrails, and roadmaps that enable scalable, secure AI solutions.

The role partners with engineering, security, data governance, and product teams to translate business goals into platform designs, mentoring engineers and advancing best practices in LLMOps/ModelOps and Responsible AI.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
• 1+ years in architecture roles with cloud and GenAI/LLM systems.
• Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools.
• Proficiency in CI/CD for ML/LLM workloads; English (B2+/C1).

Responsibilities

• Design enterprise generative AI reference architectures, blueprints, and reusable patterns.
• Define multi-cloud platform foundations addressing networking, identity, and secrets management.
• Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies.
• Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP).
• Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied.
• Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques.
• Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques.
• Collaborate with cross-functional teams to align system requirements with strategic objectives.

Skills

Cloud platforms

IaC tools

Docker/Kubernetes

CI/CD pipelines

LLM platforms

Security/compliance

English proficiency

Architecture experience

Multi-cloud

Education

Bachelor degree

Tools

Terraform

Bicep

CDK

CloudFormation

Jenkins

GitHub Actions

GitLab CI

Azure DevOps

Job description

We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform.

The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions — including LLMs, agentic applications, and tool integrations — across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps.

Responsibilities

• Design enterprise generative AI reference architectures, blueprints, and reusable patterns
• Define multi-cloud platform foundations addressing networking, identity, and secrets management
• Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies
• Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)
• Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied
• Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques
• Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques
• Collaborate with cross-functional teams to align system requirements with strategic objectives

Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
• 1+ years in architecture roles involving cloud, data, or production Generative AI/LLM systems
• Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation)
• Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshes
• Proficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)
• Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI
• Familiarity with security-by-design principles and compliance frameworks tailored to GenAI systems
• Advanced proficiency in English (B2+/C1)

We offer

• We gather like-minded people:
  • Top tech minds driving innovation in AI, cloud and digital platform modernization
  • Supportive team and agile, startup-like culture
  • Hybrid by design mode and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Business-driven relocation opportunities
• We provide growth opportunities:
  • Career development programs
  • Thought leadership, mentoring, soft skills and well-being programs
  • Certification (Anthropic, Gemini, GCP, Azure, AWS)
  • English classes
• We cover it all:
  • Stable pay
  • Participation in the Employee Stock Purchase Plan with a 15% discount
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Referral bonuses up to $2,000
  • Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
  • Corporate, social and well-being events
• Please, note:
  • Benefits listed above are available to employees only
  • We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
  • We will reach out to selected candidates exclusively

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.