Senior AI/ML Software Engineer — Accelerator Optimization

Annapurna Labs (U.S.) Inc.

Seattle (WA)

On-site

USD 150,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Amazon Web Services (AWS) Neuron team is seeking a Senior Software Engineer to optimize ML models on custom AI accelerators (Inferentia/Trainium). You will design, develop, and optimize distributed inference for PyTorch within the Neuron SDK and collaborate across compiler, runtime, framework, and hardware teams.

Join a cross-functional group focused on high-performance computing, system-level optimization, and production deployment for Generative AI workloads at scale.

Qualifications

  • Strong software development skills with Python and low-level optimization.
  • Experience with ML workloads and model acceleration.
  • Familiarity with distributed inference and ML frameworks, especially PyTorch.

Responsibilities

  • Design, develop, and optimize machine learning models including GPT, Kimi, and Qwen on custom AI accelerators.
  • Participate in all stages of the ML system development lifecycle including distributed computing based architecture design, implementation, performance profiling, low level optimizations, and production deployment.
  • Build infrastructure to systematically analyze and onboard multiple models with diverse architecture.
  • Design and implement high-performance kernels and features for ML operations, leveraging the Neuron architecture and programming models
  • Analyze and optimize system-level performance across multiple generations of Neuron hardware
  • Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
  • Implement optimizations such as fusion, sharding, tiling, and scheduling
  • Work directly with customers to enable and optimize their ML models on AWS accelerators
  • Collaborate across teams to develop innovative optimization techniques
  • Develop kernels to improve model efficiency on Amazon AI Accelerators
  • Transform complex tensor operations into highly optimized graph implementations
  • Optimize state-of-the-art language, vision, and multimodal generative AI models for Neuron hardware

Skills

Python
System-level programming
ML knowledge
PyTorch

Job description

Amazon Web Services (AWS) Neuron team is seeking a Senior Software Engineer to optimize ML models on custom AI accelerators (Inferentia/Trainium). You will design, develop, and optimize distributed inference for PyTorch within the Neuron SDK and collaborate across compiler, runtime, framework, and hardware teams.

Join a cross-functional group focused on high-performance computing, system-level optimization, and production deployment for Generative AI workloads at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer I: ML Inference & Accelerator Optimization
Software Engineer I: ML Inference & Accelerator Optimization

Amazon Web Services • Cupertino (CA)

On-site
USD 127,000 - 185,000
Health insurance
RSUs
401(k) matching
+2
Senior ML Engineer - AI/ML on Custom Accelerators
Senior ML Engineer - AI/ML on Custom Accelerators

Amazon Inc. • Seattle (WA)

Hybrid
USD 168,000 - 227,000
RSUs
Sign-on bonus
Health insurance
+1
Sr. Software Engineer- AI/ML, AWS Neuron
Sr. Software Engineer- AI/ML, AWS Neuron

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 150,000 - 190,000
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Software Engineer - AI/ML, AWS Neuron Apps
Software Engineer - AI/ML, AWS Neuron Apps

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 120,000 - 160,000
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Software Engineer II - AI/ML, AWS Neuron
Software Engineer II - AI/ML, AWS Neuron

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 180,000 - 260,000
AI/ML Systems Engineer - Neuron Inference
AI/ML Systems Engineer - Neuron Inference

Amazon • Seattle (WA)

On-site
USD 144,000 - 194,000
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Sr. Software Engineer- AI/ML, AWS Neuron
Sr. Software Engineer- AI/ML, AWS Neuron

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000