Senior Manager, EC2 Nitro, EC2 Nitro

Socket.dev; Seattle (WA); On-site; USD 220,000 - 298,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Parental leave

Job summary

Amazon is seeking a seasoned engineering leader to own an at-scale ML compute platform. You will set multi-year strategy and lead 3–5 managers and ~40–50 engineers across hardware bring-up, firmware, cluster management, and application software.

You will collaborate with silicon partners (NVIDIA, Annapurna) and AWS ML teams to align roadmaps, drive execution, and influence cross-organizational priorities. A strong Linux and systems software background is essential.

Qualifications

• 10+ years of engineering leadership experience.
• 5+ years of engineering team management experience.
• 10+ years of planning, designing, developing and delivering consumer software experience.

Responsibilities

• Own an existing at-scale ML compute platform and drive multi-year technical strategy.
• Lead a team of managers and engineers to deliver platform capabilities across hardware, firmware, and software.
• Partner with hardware and ML teams to align roadmaps and land capabilities at scale.

Skills

Engineering management

Large-scale software delivery

Linux systems

C/C++/Rust

ML frameworks & cluster management

Tools

Git

CI/CD

Job description

EC2 Nitro drives the planet's largest, fastest growing, and most feature-rich compute cloud, and EC2 Machine Learning Systems (MLS) is where that platform meets the most demanding AI workloads on Earth. We build and scale the compute platforms behind AWS's largest ML training and inference clusters -- integrating custom hardware, firmware, systems software, and services to turn AI accelerators (NVIDIA GB200/GB300/VeraRubin-class UltraServer/UltraCluster) into reliable, high-performance capacity for customers ranging from startups to the largest AI labs in the world.

We are looking for a seasoned engineering leader to own an existing, at-scale ML compute platform and to set and drive its multi-year technical strategy. As a Senior Manager leading a team of 3-5 managers and roughly 40-50 engineers, you will be responsible for the health, velocity, and long-term direction of an organization that spans hardware bring-up, firmware, cluster management, and application software. You will define where the platform needs to be several years out, make the architectural and investment bets that get us there, and build the org -- leaders, senior engineers, and mechanisms -- capable of delivering it.

In this role, you will operate at the intersection of a broad and deep set of technical teams. You will partner at a senior level with silicon and hardware partners (Annapurna and NVIDIA) to co-design and bring up NVIDIA GB200/GB300 platforms and UltraServer/UltraCluster systems, and with science, ML framework, and other AWS service organizations to remove ambiguity, align roadmaps, and land capabilities that no single team could deliver alone. You will be measured not only on what your organization ships, but on the clarity of the technical strategy you set and your ability to influence direction well beyond your immediate teams.

The ideal candidate:

• Has a deep technical background in systems software -- sufficient to earn the trust of senior engineers and make sound architectural and design judgments in a Linux environment involving C, C++, and/or Rust. You will not be writing production code day-to-day, but you must be able to go deep, ask the right questions, and hold a high technical bar.
• Brings strong operational instincts for large-scale software delivery -- version control, automated build and release, and software quality practices -- and knows how to instill them across an organization.
• Has in-depth knowledge of ML frameworks and cluster management, and understands the workloads and failure modes of large-scale ML training and inference at cluster scale.
• Has a track record of setting multi-year technical strategy, driving org-level execution through other managers, and influencing partners across organizational boundaries.

Basic Qualifications:

• 10+ years of engineering experience
• 5+ years of engineering team management experience
• 10+ years of planning, designing, developing and delivering consumer software experience
• Experience partnering with product or program management teams
• Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Preferred Qualifications:

• Experience partnering with product and program management teams
• Experience participating in or leading technical collaborations and creating alignment across diverse groups (e.g., hardware engineering, software engineering, program management)
• Experience hiring, developing and promoting engineering talent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 220,100.00 - 297,700.00 USD annually