Lead DevOps Engineer, AI Platform

EPAM Systems; United States; Remote; USD 150,000 - 230,000; Full time

Job summary

EPAM Systems Inc. seeks a Lead DevOps Engineer to guide the platform transition, retire legacy apps, and reinforce MCP Hosting Infra and AI Marketplace. You will set technical direction and elevate engineering standards while shaping bot support and cross-team collaboration.

You will drive architecture improvements on AWS/Kubernetes, mentor staff, and establish on-call and observability practices to ensure reliable operations. English proficiency a must.

Qualifications

• 5+ years of experience in DevOps or Site Reliability Engineering (SRE).
• Proven experience leading technical initiatives end-to-end, including migrations or decommissions.
• Strong expertise in AWS, Terraform, and Amazon Elastic Kubernetes Service, with solid Kubernetes experience.
• Solid background in monitoring and observability practices.
• Experience building authentication or credential-management systems with OAuth2, or running them at scale.
• Experience designing on-call and support processes, rather than simply taking part in them.
• Proven ability to mentor others and make practical trade-offs.
• English proficiency at a B2+ level.
• Nice to have: Familiarity with Model Context Protocol.
• Proficiency in Python and TypeScript.

Responsibilities

• Lead the spin-down of two applications, including migration plans, stakeholder communication, and decommissioning.
• Shape the architecture and reliability of MCP Hosting Infra (Kubernetes on AWS), including the gateway and per-user credential handling, by proposing improvements to the existing design.
• Drive the ongoing development of AI Marketplace.
• Establish the support automation strategy, determining which requests the bot handles, what tools and permissions it needs, and how resolution rate is tracked.
• Set standards for Terraform, observability, runbooks, and on-call practices.
• Analyze bot escalations for recurring patterns and convert them into prioritized automation initiatives.
• Mentor mid-level engineers through code reviews, design reviews, and pairing sessions.
• Serve as the escalation point for complex incidents and cross-team requests.
• Collaborate with product and other teams to prioritize work and align expectations.

Skills

Leadership

Mentoring

On-call processes

English proficiency

OAuth2 authentication

Python

TypeScript

Automation mindset

Tools

AWS

Terraform

Kubernetes (EKS)

Amazon Elastic Kubernetes Service

Job description

We're looking for a Lead DevOps Engineer to act as the technical lead during our platform's transition, cleanly retiring legacy applications while reinforcing MCP Hosting Infra and AI Marketplace. This role involves setting technical direction, guiding the growth of the support bot, and elevating the standards of the broader engineering team.

Responsibilities

• Lead the spin-down of two applications, including migration plans, stakeholder communication, and decommissioning
• Shape the architecture and reliability of MCP Hosting Infra (Kubernetes on AWS), including the gateway and per-user credential handling, by proposing improvements to the existing design
• Drive the ongoing development of AI Marketplace
• Establish the support automation strategy, determining which requests the bot handles, what tools and permissions it needs, and how resolution rate is tracked
• Set standards for Terraform, observability, runbooks, and on-call practices
• Analyze bot escalations for recurring patterns and convert them into prioritized automation initiatives
• Mentor mid-level engineers through code reviews, design reviews, and pairing sessions
• Serve as the escalation point for complex incidents and cross-team requests
• Collaborate with product and other teams to prioritize work and align expectations

Requirements

• 5+ years of experience in DevOps or Site Reliability Engineering
• Proven experience leading technical initiatives end-to-end, including migrations or decommissions
• Strong expertise in AWS, Terraform, and Amazon Elastic Kubernetes Service, with solid Kubernetes experience strongly preferred
• Solid background in monitoring and observability practices
• Experience building authentication or credential-management systems with OAuth2, or running them at scale
• Experience designing on-call and support processes, rather than simply taking part in them
• Proven ability to mentor others and make practical trade-offs
• English proficiency at a B2+ level
• Nice to have: Familiarity with Model Context Protocol
• Proficiency in Python and TypeScript