Lead ML Infrastructure for Edge AI Platform

Amazon Inc.; Bellevue (WA); On-site; USD 185,000 - 250,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

RSU/stock options

Job summary

Amazon.com Services LLC is seeking a Software Development Manager for the Edge AI ML Platform and Infrastructure to lead a distributed training team across multi-node GPU clusters. You will own capacity planning, CI/CD, and observability, guiding engineers and scientists to ship models at scale, with a strong emphasis on reliability and performance.

You will recruit, mentor, and develop leaders, shape architecture decisions, and translate complex scientific needs into a practical, prioritized

Qualifications

• 3+ years of engineering team management experience.
• 7+ years of working directly within engineering teams experience.
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience.
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations.
• Experience partnering with product or program management teams.
• Experience managing a team of high calibre Software Engineers developing complex, world class, scalable software systems that have been successfully delivered to customers.

Responsibilities

• Build, lead, and grow a team of software and ML infrastructure engineers: recruit and hire, set clear goals, coach for growth, and manage performance across the team.
• Own the roadmap for ML infrastructure—distributed training, GPU capacity, workflow orchestration, CI/CD, and observability—balancing near-term deliveries with long-term platform health.
• Drive the architecture of distributed training capabilities (data, tensor, pipeline, and model parallelism) for large language and multimodal models, partnering with senior engineers and applied scientists.
• Establish operational excellence for production platform services, including metrics, alarms, runbooks, on‑call processes, and root‑cause correction of recurring issues, while owning GPU fleet efficiency, capacity planning, and cost optimization.
• Partner with applied science, compiler, runtime, hardware, security, and product teams to align requirements, manage dependencies, and deliver cross‑team programs.

Skills

Team management

Software engineering

Cross-functional collaboration

Product/PM partnership

Site reliability and ops

Leadership coaching

Tools

MXNet

TensorFlow

Caffe

PyTorch

Job description

Amazon.com Services LLC is seeking a Software Development Manager for the Edge AI ML Platform and Infrastructure to lead a distributed training team across multi-node GPU clusters. You will own capacity planning, CI/CD, and observability, guiding engineers and scientists to ship models at scale, with a strong emphasis on reliability and performance.

You will recruit, mentor, and develop leaders, shape architecture decisions, and translate complex scientific needs into a practical, prioritized