Senior DevOps Engineer, AI Platform

EPAM Systems; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

EPAM Systems Inc. is seeking a Senior DevOps Engineer to act as technical lead for transitioning the platform, retiring legacy apps, and strengthening MCP Hosting Infra and AI Marketplace.

You will set technical direction, influence the support bot development, and raise the bar for engineers on the team. The role emphasizes end-to-end migrations/decommissions, strong AWS/Terraform/Kubernetes expertise, and designing scalable authentication and on-call processes while mentoring others and

Qualifications

• 3+ years in DevOps or SRE.
• Led end-to-end migrations or decommissions.
• AWS, Terraform and EKS expertise; strong Kubernetes.
• Monitoring and observability background.
• OAuth2 credential-management experience.
• On-call and support process design.
• Mentor teammates; pragmatic trade-offs.
• English proficiency at B2+.
• Nice to have Python/TypeScript MCP skills.

Responsibilities

• Lead spin-down of two applications with migration plans and comms.
• Influence MCP Hosting Infra reliability; Kubernetes on AWS.
• Guide evolution of AI Marketplace.
• Define support automation strategy and bot scope.
• Set standards for Terraform, observability, runbooks, on-call.
• Mentor mid-level engineers through code/design reviews.

Skills

DevOps

SRE

AWS

Terraform

Kubernetes

OAuth2

Observability

On-call

Mentoring

Job description

We are seeking a Senior DevOps Engineer to serve as technical lead for our platform's transition, retiring legacy applications cleanly while strengthening MCP Hosting Infra and AI Marketplace. In this role, you will set technical direction, shape how the support bot grows, and raise the bar for the engineers around you.

Responsibilities

• Lead the spin-down of two applications, including migration plans, stakeholder communication, and decommissioning
• Influence the architecture and reliability of MCP Hosting Infra (Kubernetes on AWS), including the gateway and per-user credential handling, by recommending changes that improve the current design
• Guide the evolution of AI Marketplace
• Define the support automation strategy, including which requests the bot resolves, which tools and permissions it gets, and how resolution rate is measured
• Set standards for Terraform, observability, runbooks, and on-call practices
• Review bot escalations for patterns and turn them into prioritized automation work
• Mentor mid-level engineers through code review, design review, and pairing
• Act as the escalation point for complex incidents and cross-team requests
• Partner with product and other teams to prioritize work and set expectations

Requirements

• 3+ years of experience in DevOps or Site Reliability Engineering
• Track record of leading technical work end to end, including migrations or decommissions
• Expertise in AWS, Terraform, and Amazon Elastic Kubernetes Service, with strong Kubernetes experience strongly preferred
• Background in monitoring and observability practices
• Experience designing authentication or credential-management systems using OAuth2, or operating them at scale
• Experience designing on-call and support processes, not just participating in them
• Demonstrated ability to mentor and to make pragmatic trade-offs
• Proficiency in English at a B2+ level
• Nice to have Familiarity with Model Context Protocol Skills in Python and TypeScript