ML Systems Engineer II for Neuron AI Acceleration

Annapurna Labs (U.S.) Inc.

Seattle (WA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annapurna Labs (U.S.) Inc. in Seattle is seeking engineers to design, develop, and optimize ML frameworks for AWS Neuron and related accelerators.

You will work across ML models, kernels, and software stacks to maximize performance on Inferentia and Trainium hardware. The role requires expertise in ML systems, distributed architectures, and production deployment, with hands-on work in PyTorch/JAX and compiler/runtime integration.

Qualifications

  • Experience designing ML models and frameworks for custom ML hardware.
  • Strong background in performance profiling and hardware-specific optimizations.
  • Experience with distributed system design and production deployment.

Responsibilities

  • Design, develop, and optimize ML models and frameworks for custom ML hardware accelerators.
  • Lead ML system development lifecycle from architecture to deployment.
  • Build infrastructure to onboard multiple models with diverse architectures.
  • Develop high-performance kernels leveraging the Neuron architecture.
  • Analyze system-level performance across Neuron generations.
  • Profile and resolve performance bottlenecks with tooling.

Skills

ML system design
Performance optimization
Distributed computing
Kernel development
Profiling and debugging
Mentoring engineers

Tools

PyTorch
JAX
Neural network compilers
Profiling tools

Job description

Annapurna Labs (U.S.) Inc. in Seattle is seeking engineers to design, develop, and optimize ML frameworks for AWS Neuron and related accelerators.

You will work across ML models, kernels, and software stacks to maximize performance on Inferentia and Trainium hardware. The role requires expertise in ML systems, distributed architectures, and production deployment, with hands-on work in PyTorch/JAX and compiler/runtime integration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Engineer for AI/LLM Inference on AWS Neuron
ML Systems Engineer for AI/LLM Inference on AWS Neuron

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
AI/ML Systems Engineer - Neuron Inference
AI/ML Systems Engineer - Neuron Inference

Amazon • Seattle (WA)

On-site
USD 144,000 - 194,000
ML Inference Engineer - AWS Neuron & GenAI
ML Inference Engineer - AWS Neuron & GenAI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Senior ML Compiler Engineer – Neuron
Senior ML Compiler Engineer – Neuron

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior ML Inference Engineer - Neuron Optimizations
Senior ML Inference Engineer - Neuron Optimizations

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
RSUs
Paid time off
+1
Senior ML Kernel Optimizer for AWS Neuron
Senior ML Kernel Optimizer for AWS Neuron

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
AI/ML Software Engineer II: High-Performance Inference
AI/ML Software Engineer II: High-Performance Inference

Amazon Inc. • Cupertino (CA)

On-site
USD 165,000 - 224,000