Senior ML Inference Engineer - Neuron Optimizations

Annapurna Labs (U.S.) Inc.

Seattle (WA)

On-site

USD 144,000 - 194,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
RSUs
Paid time off
Parental leave

Job summary

Annapurna Labs (U.S.) Inc. is seeking a senior software engineer for the Machine Learning Inference Applications team in Seattle, WA. The role focuses on developing and optimizing core blocks for LLM Inference on AWS Inferentia/Trainium hardware.

You will work with chip architects, compiler and runtime engineers to maximize performance and accuracy across models, mentoring junior engineers and contributing to scalable system design.

Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems
  • 1+ years of software development engineer or related occupational experience
  • 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl
  • 1+ years of Object Oriented Design experience
  • Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
  • Experience programming with at least one software programming language

Responsibilities

  • Adapt latest research in LLM optimization to Neuron chips to extract best performance from models.
  • Work across teams and organizations to deliver performance and accuracy on Neuron devices.
  • Collaborate with chip architects, compiler engineers and runtime engineers to optimize building blocks such as Attention, MLP, Quantization and Decoding.

Skills

C#
C++
Java
Perl
Object Oriented Design
Software development

Education

Bachelor's degree in Computer Science or related field

Job description

Annapurna Labs (U.S.) Inc. is seeking a senior software engineer for the Machine Learning Inference Applications team in Seattle, WA. The role focuses on developing and optimizing core blocks for LLM Inference on AWS Inferentia/Trainium hardware.

You will work with chip architects, compiler and runtime engineers to maximize performance and accuracy across models, mentoring junior engineers and contributing to scalable system design.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
Senior ML Inference Engineer — High-Performance LLM Serving
Senior ML Inference Engineer — High-Performance LLM Serving

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+2
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior ML Compiler Engineer – Neuron
Senior ML Compiler Engineer – Neuron

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior SDE — Neuron Inference & LLM Optimization
Senior SDE — Neuron Inference & LLM Optimization

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
ML Inference Engineer - AWS Neuron & GenAI
ML Inference Engineer - AWS Neuron & GenAI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
ML Systems Engineer II for Neuron AI Acceleration
ML Systems Engineer II for Neuron AI Acceleration

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 180,000 - 260,000
Senior ML Inference Engineer - LLM Serving on Accelerators
Senior ML Inference Engineer - LLM Serving on Accelerators

Annapurna Labs • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+1
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
ML Systems Engineer for AI/LLM Inference on AWS Neuron
ML Systems Engineer for AI/LLM Inference on AWS Neuron

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000