Senior HPC Platform Engineer: Kubernetes & Multi-Cloud

EPAM Systems; New York (NY); Remote; USD 145,000 - 170,000; Full time

Benefits offered by this job

Health Insurance

LinkedIn Learning

401(k) Plan

Paid Time Off

Paid Holidays

Job summary

EPAM Systems is seeking a senior infrastructure engineer to operate and scale Kubernetes platforms across multiple cloud providers, supporting GPU-heavy workloads at massive scale.

You will design scheduling, monitor reliability, and contribute to multi-cloud tooling and incident response. The role involves collaboration with networking, storage, security, and AI/ML teams to deliver robust infrastructure.

Qualifications

• 10+ years of experience in infrastructure engineering, cloud platforms, or high-performance computing environments.
• Expert-level Kubernetes experience at meaningful scale, including node pool sizing, scheduler debugging, CNI troubleshooting, and rolling upgrades across large fleets.
• Advanced Python skills with production-grade tooling; Go/Rust/C++ are a strong plus.
• Daily proficiency in Terraform for writing and reviewing infrastructure as code.
• Working knowledge of core AWS services including EC2, S3, EFS, FSx for Lustre.
• Strong site reliability engineering background with monitoring, alerting, and incident response practices.
• CKA, CKS certificates are highly preferred.

Responsibilities

• Operate and scale Kubernetes platforms (EKS, GKE, and others) including cluster lifecycle management, node pool optimization, and networking policies during rapid growth.
• Provision and manage HPC infrastructure through CI/CD pipelines spanning AWS, CoreWeave, GCP, OCI, and other clouds.
• Design and maintain job scheduling systems to efficiently allocate GPU compute resources across workloads.
• Define SLIs/SLOs, build monitoring and alerting, and participate in incident reviews.
• Develop production-grade tooling/automation to support multi-cloud infra at scale.
• Collaborate with Networking, Storage, Security, and AI/ML teams for seamless infra delivery.

Skills

Kubernetes

Python

Go/Rust/C++

Terraform

AWS

Site Reliability Engineering

CKA/CKS

Tools

EKS

GKE

Job description

EPAM Systems is seeking a senior infrastructure engineer to operate and scale Kubernetes platforms across multiple cloud providers, supporting GPU-heavy workloads at massive scale.

You will design scheduling, monitor reliability, and contribute to multi-cloud tooling and incident response. The role involves collaboration with networking, storage, security, and AI/ML teams to deliver robust infrastructure.