Senior Manager, Software Development — AI Systems and Server, Annapurna Labs, Annapurna Labs

Socket.dev; San Diego (CA); On-site; USD 253,000 - 342,000; Full time

Job summary

Annapurna Labs in Cupertino, CA, is seeking a senior leader to head software and firmware teams responsible for system orchestration, deployment, and operations across on-premise and off-premise environments.

You will drive architecture, partner with AWS/EC2, hardware and software teams, mentor engineers, and shape a next-generation management platform for ML/AI racks and servers.

Qualifications

• 10+ years of engineering experience.
• 5+ years leading engineering teams.
• 10+ years in planning, designing and delivering consumer software.
• Experience partnering with product or program management.
• Experience managing multiple concurrent programs in Agile environments.

Responsibilities

• Lead a team of software and firmware developers driving the architecture and development of our ML/AI Systems Orchestration and Management platform.
• Partner with Systems, AWS/EC2, and Annapurna hardware and software teams to build a standalone orchestration management system that deploys and manages current and future ML/AI rack- and server-level systems at scale—including accelerator, networking, and storage systems, with a strong bias toward industry standards and best-in-class solutions.
• Collaborate across organizations to design a system that leverages existing internal infrastructure where practical, while driving toward a next-generation, customer-focused platform that is industry-standard, compliant, and OCP-compatible.
• Mentor your team through complex technical challenges and establish a minimal viable system optimized for time-to-market that scales across products.
• Shape system design and orchestration strategy through technical and customer discussions, balancing short-term on-premise proof points with the simplest possible customer adoption path for their workloads.

Skills

Engineering experience

Team management

Software lifecycle

Product collaboration

Agile environment

Job description

At Annapurna Labs, we sit at the forefront of hardware and software accelerator solutions—not just for Amazon Web Services (AWS), but across the entire industry. Our AI Systems and Server team is building the next generation of Management and Orchestration platforms for AI/ML servers, and we're looking for a leader excited to dive deep into modern orchestration, provisioning, network management, and operations.

Our team designs, builds, deploys, and operates Annapurna's fleet of accelerated servers, powered by our world-class, internally designed AI accelerator silicon, systems, and software. The systems we build support the largest AI applications in the world, alongside the most innovative startups and research universities.

In this role, you will lead a team of software and firmware developers responsible for overall system orchestration, deployment, and operations—spanning low-level boot, security management, provisioning, updates, and monitoring across both on-premise and off-premise environments.

A day in the life

• Lead a team of software and firmware developers driving the architecture and development of our newest ML/AI Systems Orchestration and Management platform.
• Partner with Systems, AWS/EC2, and Annapurna hardware and software teams to build a standalone orchestration management system that deploys and manages current and future ML/AI rack- and server-level systems at scale—including accelerator, networking, and storage systems, with a strong bias toward industry standards and best-in-class solutions.
• Collaborate across organizations to design a system that leverages existing internal infrastructure where practical, while driving toward a next-generation, customer-focused platform that is industry-standard, compliant, and OCP-compatible.
• Mentor your team through complex technical challenges and establish a minimal viable system optimized for time-to-market that scales across products.
• Shape system design and orchestration strategy through technical and customer discussions, balancing short-term on-premise proof points with the simplest possible customer adoption path for their workloads.

Basic Qualifications:

• 10+ years of engineering experience
• 5+ years of engineering team management experience
• 10+ years of planning, designing, developing and delivering consumer software experience
• Experience partnering with product or program management teams
• Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Preferred Qualifications:

• Experience partnering with product and program management teams
• Experience designing and developing large scale, high-traffic applications

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors include experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, Cupertino - 253,100.00 - 342,300.00 USD annually