Applied Scientist — ML Systems & Compiler for Neuron

Amazon Web Services (AWS)

Cupertino (CA)

On-site

USD 133,000 - 222,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Annapurna Labs (U.S.) Inc. in Cupertino seeks a scientist to advance AWS Neuron software stack for Trainium and Inferentia, collaborating with customers and internal teams to remove adoption barriers and optimize performance.

You will work with ML systems researchers and engineers, publish and share findings, and engage with the academic community to push state-of-the-art ML solutions.

Qualifications

  • PhD or Master’s with 4+ years in CS/CE/ML or related field.
  • Experience publishing in top-tier conferences or journals.
  • Experience programming in Java, C++, Python.
  • Experience in algorithms, data structures, parsing, numerial optimization, data mining, parallel/distributed computing, HPC.

Responsibilities

  • Identify adoption barriers and optimization opportunities for Trainium and Inferentia.
  • Collaborate with internal and external customers to implement solutions.
  • Work with engineering teams to integrate ML software features.
  • Engage with academic communities to advance ML systems.

Skills

Programming languages
Research publication experience
Algorithms and data structures
Parallel and distributed computing

Education

PhD or MS + 4+ years CS/CE/ML

Job description

Description

The AWS Neuron Science Team is looking for talented scientists to enhance our software stack, accelerating customer adoption of Trainium and Inferentia accelerators. In this role, you will work directly with external and internal customers to identify key adoption barriers and optimization opportunities. You'll collaborate closely with our engineering teams to implement innovative solutions and engage with academic and research communities to advance state-of-the-art ML systems. As part of a strategic growth area for AWS, you'll work alongside distinguished engineers and scientists in an exciting and impactful environment. We actively work on these areas:

  • AI for Systems: Developing and applying ML/RL approaches for kernel/code generation and optimization
  • Machine Learning Compiler: Creating advanced compiler techniques for ML workloads
  • System Robustness: Building tools for accuracy and reliability validation
  • Efficient Kernel Development: Designing high-performance kernels optimized for our ML accelerator architectures

Description

The AWS Neuron Science Team is looking for talented scientists to enhance our software stack, accelerating customer adoption of Trainium and Inferentia accelerators. In this role, you will work directly with external and internal customers to identify key adoption barriers and optimization opportunities. You'll collaborate closely with our engineering teams to implement innovative solutions and engage with academic and research communities to advance state-of-the-art ML systems. As part of a strategic growth area for AWS, you'll work alongside distinguished engineers and scientists in an exciting and impactful environment. We actively work on these areas:

  • AI for Systems: Developing and applying ML/RL approaches for kernel/code generation and optimization
  • Machine Learning Compiler: Creating advanced compiler techniques for ML workloads
  • System Robustness: Building tools for accuracy and reliability validation
  • Efficient Kernel Development: Designing high-performance kernels optimized for our ML accelerator architectures

About The Team

AWS Neuron is the software of Trainium and Inferentia, the AWS Machine Learning chips. Inferentia delivers best-in-class ML inference performance at the lowest cost in the cloud to our AWS customers. Trainium is designed to deliver the best-in-class ML training performance at the lowest training cost in the cloud, and it’s all being enabled by AWS Neuron. Neuron is a Software that include ML compiler and native integration into popular ML frameworks. Our products are being used at scale with external customers like Anthropic and Databricks as well as internal customers like Alexa, Amazon Bedrocks, Amazon Robotics, Amazon Ads, Amazon Rekognition and many more.

Basic Qualifications

  • PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • Experience programming in Java, C++, Python or related language
  • Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Preferred Qualifications

  • Experience building machine learning models or developing algorithms for business application
  • Experience in professional software development

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, Cupertino - 171,600.00 - 222,200.00 USD annually


Company - Annapurna Labs (U.S.) Inc.

Job ID: A10432388
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Applied Scientist II, Annapurna ML
Applied Scientist II, Annapurna ML

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 171,000 - 223,000
Applied Scientist, AWS Neuron Science team
Applied Scientist, AWS Neuron Science team

Amazon • Cupertino (CA)

On-site
USD 171,600 - 222,200
RSUs
Health insurance
401(k) matching
+1
Applied Scientist, AWS Neuron Science Team
Applied Scientist, AWS Neuron Science Team

Amazon • Seattle (WA)

On-site
USD 136,000 - 224,000
Flexible work environment
Mentorship and career growth opportunities
Comprehensive benefits package
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+1
Applied Scientist, AWS Neuron Science Team
Applied Scientist, AWS Neuron Science Team

Amazon.co.uk Limited • San Francisco (CA)

On-site
USD 136,000 - 223,400
Applied Scientist II, Annapurna ML
Applied Scientist II, Annapurna ML

Amazon • Cupertino (CA)

On-site
USD 171,600 - 222,200
RSUs
Sign-on bonuses
Health insurance
Neuron Runtime Software Development Engineer , Neuron Runtime
Neuron Runtime Software Development Engineer , Neuron Runtime

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
Health insurance
401(k) matching
Paid time off
+1
Applied Scientist, AWS Neuron Science team
Applied Scientist, AWS Neuron Science team

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 133,000 - 222,000
Software Development Engineer, ML Systems, Annapurna Labs
Software Development Engineer, ML Systems, Annapurna Labs

Amazon Web Services (AWS) • New York (NY)

On-site
USD 158,000 - 214,000
Neuron Runtime Software Development Engineer , Neuron Runtime
Neuron Runtime Software Development Engineer , Neuron Runtime

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 143,000 - 195,000