Senior Platform Architect: HPC & Kubernetes at Scale

EPAM Systems; New York (NY); Hybrid; USD 145,000 - 170,000; Full time

Benefits offered by this job

Medical,Dental and Vision Insurance

Health Savings Account

401(k) Retirement Savings Plan

Paid Time Off

Holiday Pay

Job summary

EPAM Systems, Inc. in New York seeks an experienced Infrastructure Engineer to operate and scale Kubernetes platforms across multi-cloud providers, supporting thousands of GPUs and large-scale workloads.

You will design and maintain HPC infrastructure, build production-grade tooling, and define SLIs/SLOs with incident response responsibilities, collaborating across Networking, Storage, Security, and AI/ML teams.

Qualifications

• 10+ years of infrastructure engineering, cloud platforms, or HPC environments.
• Expert-level Kubernetes experience at meaningful scale with cluster lifecycle, scheduling, and upgrades.
• Advanced Python skills; Go/Rust/C++ are a strong plus.
• Daily proficiency with Terraform for infrastructure as code.
• Working knowledge of core AWS services (EC2, S3, EFS, FSx for Lustre).
• Strong SRE background with monitoring, alerting, and incident response practices.
• CKA/CKS certificates are highly preferred.

Responsibilities

• Operate and scale Kubernetes platforms (EKS, GKE, and other distributions) including cluster lifecycle management, node pool optimization, and networking policies during periods of rapid growth.
• Provision and manage HPC infrastructure through CI/CD pipelines spanning AWS, CoreWeave, GCP, OCI, and additional cloud providers.
• Design and maintain job scheduling systems that efficiently allocate GPU compute resources across training and inference workloads.
• Define SLIs/SLOs, build robust monitoring and alerting systems, and actively participate in incident response and post-incident reviews.
• Develop production-quality tooling and automation to support multi-cloud infrastructure operations at scale.
• Collaborate daily with Networking, Storage, Security, and AI/ML platform teams to ensure seamless cross-functional infrastructure delivery.

Skills

Kubernetes at scale

Python

Terraform

AWS knowledge

Site reliability engineering

Tools

Go

Rust

C++

CI/CD pipelines

Job description

EPAM Systems, Inc. in New York seeks an experienced Infrastructure Engineer to operate and scale Kubernetes platforms across multi-cloud providers, supporting thousands of GPUs and large-scale workloads.

You will design and maintain HPC infrastructure, build production-grade tooling, and define SLIs/SLOs with incident response responsibilities, collaborating across Networking, Storage, Security, and AI/ML teams.