ML Infra Platform Engineer – Scale AI Accelerators

Amazon.com Services LLC; Seattle (WA); On-site; USD 180,000 - 240,000; Full time

Job summary

Amazon.com Services LLC is seeking an engineer to lead the design and implementation of ML infrastructure platforms, enabling capacity management, workload scheduling, and fleet orchestration across ML accelerators.

You will collaborate with ML scientists, infrastructure engineers, hardware teams, and internal customers to ensure low wait times, high utilization, and zero-config deployment across environments.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience of new and existing systems.
• Experience programming with at least one software programming language.

Responsibilities

• Lead the design and implementation of ML infrastructure platform for capacity management, workload scheduling, and fleet orchestration.
• Collaborate with ML scientists, training infrastructure engineers, hardware teams, and internal customers to deliver seamless ML Infra access.
• Build high-impact solutions, participate in design discussions, code reviews, and communicate with stakeholders.
• Work in a startup-like development environment, focusing on the most important tasks.

Skills

Go

Java

Python

JavaScript/TypeScript

Education

Bachelor's degree in computer science or equivalent

Tools

Kubernetes

Git

Job description

Amazon.com Services LLC is seeking an engineer to lead the design and implementation of ML infrastructure platforms, enabling capacity management, workload scheduling, and fleet orchestration across ML accelerators.

You will collaborate with ML scientists, infrastructure engineers, hardware teams, and internal customers to ensure low wait times, high utilization, and zero-config deployment across environments.