ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Amazon; Cupertino (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Amazon's Annapurna Labs in the AWS Neuron group seeks a dedicated ML Kernel Performance Engineer to design and optimize high-performance compute kernels for ML workloads on Inferentia and Trainium. You will push kernel optimization boundaries across generations and collaborate with cross-functional teams.

This role partners directly with customers to tune models for AWS accelerators, applies compiler optimizations, and participates in design reviews and code quality activities in a startup-like

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience for new and existing systems.
• Experience programming with at least one software programming language.
• 3+ years of full software development life cycle experience, including coding standards, reviews, and operations.
• Bachelor’s degree in computer science or equivalent.

Responsibilities

• Design and implement high-performance compute kernels for ML operations leveraging the Neuron architecture.
• Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
• Conduct detailed performance profiling to identify bottlenecks and optimize them.
• Apply compiler optimizations such as fusion, tiling, and scheduling.
• Work directly with customers to enable and optimize ML models on AWS accelerators.

Skills

Software development

System design

Programming language

Education

Bachelor's degree in Computer Science

Job description

ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

The Annapurna Labs team at Amazon Web Services builds AWS Neuron, the SDK used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team works at the hardware-software boundary, crafting high-performance kernels for ML functions to maximize performance on our custom ML accelerators.

Key Job Responsibilities

• Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models.
• Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
• Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks.
• Implement compiler optimizations such as fusion, sharding, tiling, and scheduling.
• Work directly with customers to enable and optimize their ML models on AWS accelerators.
• Collaborate across teams to develop innovative kernel optimization techniques.

A Day in the Life

• Design and code solutions to drive efficiencies in software architecture, building metrics, implementing automation, and resolving software defects.
• Build high-impact solutions for a large customer base.
• Participate in design discussions, code review, and communicate with internal and external stakeholders.
• Work cross-functionally to contribute to business decisions with technical input.
• Operate in a startup-like environment, focusing on high-priority work.

Basic Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability, scaling) of new and existing systems.
• Experience programming with at least one software programming language.

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• Bachelor’s degree in computer science or equivalent.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.