Software Engineer I: ML Inference & Accelerator Optimization

Amazon Web Services

Cupertino (CA)

On-site

USD 127,000 - 185,000

Full time

26 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
RSUs
401(k) matching
Paid time off
Parental leave

Job summary

Amazon Annapurna Labs at AWS Neuron Inference seeks a Software Development Engineer I to optimize inference models for Trainium and contribute to high-performance kernels. You will work across frameworks from PyTorch to the hardware boundary, collaborating with hardware design, compiler, and ML teams to enable scalable AI acceleration.

Join a fast, learning-focused team shaping the future of deep learning inference on AWS accelerators, with opportunities to impact model enablement and

Qualifications

  • Experience with data structures, algorithms, and object-oriented design.
  • Bachelor's degree or higher in CS/CE/EE or related field.
  • Experience with programming languages such as Python, Java, or C++.

Responsibilities

  • Optimize open models to run best on Trainium, including sharding, developing NKI kernels and ensuring accuracy.
  • Collaborate with hardware design, firmware, compiler, runtime, and ML engineers to enable and optimize custom ML accelerator silicon.
  • Write clean, maintainable code (C/C++, Python, or Rust) for systems-level, performance-critical development.
  • Participate in code reviews, contribute to documentation, and deploy tools to accelerate model enablement on Trainium.
  • Demonstrate operational excellence via monitoring, debugging, and issue resolution across hardware-software boundaries, including on-call duties.
  • Keep learning emerging technologies in ML accelerators, compiler optimization, computer architecture, and cloud-scale distributed systems.

Skills

Data structures
Algorithms
OO design
Python
Java
C++

Education

Bachelor's degree in Computer Science/Engineering or related field

Job description

Amazon Annapurna Labs at AWS Neuron Inference seeks a Software Development Engineer I to optimize inference models for Trainium and contribute to high-performance kernels. You will work across frameworks from PyTorch to the hardware boundary, collaborating with hardware design, compiler, and ML teams to enable scalable AI acceleration.

Join a fast, learning-focused team shaping the future of deep learning inference on AWS accelerators, with opportunities to impact model enablement and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Systems Engineer - Neuron Inference
AI/ML Systems Engineer - Neuron Inference

Amazon • Seattle (WA)

On-site
USD 144,000 - 194,000
AI/ML Software Engineer II: High-Performance Inference
AI/ML Software Engineer II: High-Performance Inference

Amazon Inc. • Cupertino (CA)

On-site
USD 165,000 - 224,000
ML Inference Engineer - AWS Neuron & GenAI
ML Inference Engineer - AWS Neuron & GenAI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Senior AI/ML Software Engineer: Inference on Trainium
Senior AI/ML Software Engineer: Inference on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
RSUs
Health insurance
401(k) matching
+1
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Talemexa • Cupertino (CA)

On-site
USD 140,000 - 190,000
Lead ML Systems Engineer – AI/GenAI Acceleration
Lead ML Systems Engineer – AI/GenAI Acceleration

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
RSUs (restricted stock units)
401(k) matching
+2
Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
Applied Scientist – ML Systems & Accelerators
Applied Scientist – ML Systems & Accelerators

About Amazon • Cupertino (CA)

Hybrid
USD 172,000 - 222,000
Health insurance
RSUs
Sign-on payments
+3