SDE II: ML Infra & Orchestration for AI Accelerators

Amazon Inc.; Seattle (WA); Hybrid; USD 144,000 - 194,000; Full time

Benefits offered by this job

Health insurance

RSUs (restricted stock units)

401(k) matching

Job summary

Amazon.com Services LLC is seeking a Software Engineer to lead the development of ML tooling and infrastructure. You will drive capacity management and fleet orchestration across ML accelerators while collaborating with ML scientists, hardware teams, and internal customers to ensure fast, reliable access to ML resources.

You will design scalable software, participate in code reviews, and advocate for efficient, low-latency deployment across environments in a startup-like development setting.

Qualifications

• 3+ years of professional software development experience.
• 2+ years in design/architecture of new and existing systems (scaling, reliability).
• Experience programming in at least one language.

Responsibilities

• Lead the design and implementation of ML infrastructure platform.
• Build capacity management, workload scheduling, and fleet orchestration for ML accelerators.
• Collaborate with ML scientists, training infra engineers, and hardware teams to deliver seamless access with low wait times.

Skills

Go/Java

Python

JavaScript/TypeScript

Education

Bachelor's degree in computer science or equivalent

Tools

Kubernetes

Git

CI/CD

Distributed systems

Job description

Amazon.com Services LLC is seeking a Software Engineer to lead the development of ML tooling and infrastructure. You will drive capacity management and fleet orchestration across ML accelerators while collaborating with ML scientists, hardware teams, and internal customers to ensure fast, reliable access to ML resources.

You will design scalable software, participate in code reviews, and advocate for efficient, low-latency deployment across environments in a startup-like development setting.