Senior ML Infrastructure SDE - GPU Clusters & CI/CD

Amazon Inc.; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon is seeking a Senior Software Development Engineer for the ML Infrastructure team to own and evolve platforms ensuring peak performance of ML and HPC workloads on AWS. You will build CI/CD pipelines, manage large GPU clusters, and drive performance insights that influence EC2 launch decisions.

You will write Python and TypeScript CDK code, operate SLURM/AWS ParallelCluster, and create dashboards with Grafana and Athena.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• 5+ years of leading design or architecture of new and existing systems.
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Own the infrastructure that monitors and reports on functionality and performance of large testing workloads.
• Build and operate CI/CD systems to automate testing and delivery of ML libraries.
• Write Python code to orchestrate large clusters and run benchmarks across diverse configurations.
• Use Grafana and Athena to digest performance data and create dashboards and alarms.
• Drive cross-team readiness for new instance launches and manage GPU compute capacity planning.

Skills

CI/CD automation

GPU clusters

Python

TypeScript

Linux

SLURM

AWS

Education

Bachelor's degree in computer science or equivalent

Tools

Jenkins

AWS ParallelCluster

CDK

Grafana

Athena

Job description

Amazon is seeking a Senior Software Development Engineer for the ML Infrastructure team to own and evolve platforms ensuring peak performance of ML and HPC workloads on AWS. You will build CI/CD pipelines, manage large GPU clusters, and drive performance insights that influence EC2 launch decisions.

You will write Python and TypeScript CDK code, operate SLURM/AWS ParallelCluster, and create dashboards with Grafana and Athena.