Software Development Manager: LLM Inference Enablement

Amazon; Cupertino (CA); On-site; USD 213,000 - 288,000; Full time

Benefits offered by this job

RSUs (Restricted Stock Units)

Health insurance

401(k) plan

Job summary

Amazon in Cupertino, CA, is seeking a Senior Development Manager for LLM Inference Model Enablement to lead a team of AI/ML engineers focused on onboarding and optimizing state-of-the-art open-source and customer LLMs for Trainium accelerators.

You will drive model enablement speed, usability, and quality across the PyTorch inference library, Neuron compiler, runtime, and collectives, while managing priorities and delivering high-performance inference on Trainium hardware.

Qualifications

• 3+ years of engineering team management experience.
• 7+ years of working directly within engineering teams.
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience.
• Experience partnering with product or program management teams.

Responsibilities

• Management and execution against project plans and delivery commitments
• Manage the day-to-day activities of the engineering team
• Management of resources, staffing, mentoring, and maintaining a best-of-class engineering team
• Report on status of development, quality, operations, and model performance to management

Skills

Engineering management

Team leadership

System design

Cross-functional collaboration

Job description

Amazon in Cupertino, CA, is seeking a Senior Development Manager for LLM Inference Model Enablement to lead a team of AI/ML engineers focused on onboarding and optimizing state-of-the-art open-source and customer LLMs for Trainium accelerators.

You will drive model enablement speed, usability, and quality across the PyTorch inference library, Neuron compiler, runtime, and collectives, while managing priorities and delivering high-performance inference on Trainium hardware.