Lead, ML Hardware Fleet Operations & Automation

Amazon; Austin (TX); On-site; USD 175,000 - 237,000; Full time

Job summary

Amazon Annapurna Labs' MLA Fleet Operations team seeks a Manager to lead 5–10 engineers across multiple ML server platforms, owning fleet health, automation, and data infrastructure at scale. You will define a 6–12 month roadmap, influence priorities, and drive operational excellence across cutting-edge ML hardware.

In this role you will mentor engineers, partner with hardware/software/product teams, and represent fleet operations in executive reviews with data-driven narratives.

Qualifications

• Bachelor's degree in computer science, electrical engineering, or related field.
• 2+ years of engineering team management experience.
• Knowledge of and proficiency in Python scripting language.
• Experience with general troubleshooting/debugging of hardware.
• Experience designing, building, operating, and managing large-scale distributed systems or web services.
• 7+ years of experience in systems engineering, platform engineering, SRE, or hardware operations.

Responsibilities

• Build, hire, mentor, and grow a team of platform development engineers responsible for ML fleet operations across multiple accelerator platforms
• Define team roadmap and technical strategy for fleet health, automation, and data infrastructure — balancing near-term operational demands against long-term engineering investments
• Drive operational excellence by establishing metrics, SLAs, and processes that maximize platform sellability and customer experience
• Partner with hardware engineering, software engineering, and product teams to prioritize debug efforts and translate fleet learnings into permanent design fixes
• Own escalation paths for critical fleet incidents and lead cross-functional war rooms to resolution
• Influence org-level priorities by surfacing fleet-wide patterns and advocating for systemic improvements across the ML hardware portfolio
• Raise the bar on team software practices — ensuring automation is maintainable, tested, documented, and reusable at scale
• Represent fleet operations in executive reviews, providing data-driven narratives on platform health and roadmap

Skills

Engineering management

Python scripting

Hardware debugging

Distributed systems

SRE experience

Education

Bachelor's degree in CS/EE or related field

Job description

Amazon Annapurna Labs' MLA Fleet Operations team seeks a Manager to lead 5–10 engineers across multiple ML server platforms, owning fleet health, automation, and data infrastructure at scale. You will define a 6–12 month roadmap, influence priorities, and drive operational excellence across cutting-edge ML hardware.

In this role you will mentor engineers, partner with hardware/software/product teams, and represent fleet operations in executive reviews with data-driven narratives.