ML Systems Engineer for AI/LLM Inference on AWS Neuron

Annapurna Labs (U.S.) Inc.

Cupertino (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annapurna Labs (U.S.) Inc. at AWS Neuron is seeking engineers to design, develop, and optimize ML models and frameworks for custom hardware accelerators (Inferentia and Trainium).

You will work across the ML stack from frameworks to kernels, improving performance for deep learning and GenAI workloads. Join a high-performance team dedicated to pushing the boundaries of AI acceleration, collaborating with customers to enable scalable model enablement and ensuring top-tier inference and training

Responsibilities

  • Design, develop, and optimize ML models and frameworks for deployment on custom ML hardware accelerators.
  • Participate in all stages of ML system development, including distributed architecture, performance profiling, optimization, and deployment.
  • Build infrastructure to analyze and onboard multiple models with diverse architectures.
  • Design and implement high-performance kernels and features for ML operations using the Neuron architecture.
  • Analyze system-level performance across generations of Neuron hardware.
  • Conduct detailed performance analysis with profiling tools to identify bottlenecks.
  • Implement optimizations to improve latency and throughput across workloads.

Job description

Annapurna Labs (U.S.) Inc. at AWS Neuron is seeking engineers to design, develop, and optimize ML models and frameworks for custom hardware accelerators (Inferentia and Trainium).

You will work across the ML stack from frameworks to kernels, improving performance for deep learning and GenAI workloads. Join a high-performance team dedicated to pushing the boundaries of AI acceleration, collaborating with customers to enable scalable model enablement and ensuring top-tier inference and training

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Inference Engineer - AWS Neuron & GenAI
ML Inference Engineer - AWS Neuron & GenAI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
ML Systems Engineer II for Neuron AI Acceleration
ML Systems Engineer II for Neuron AI Acceleration

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 180,000 - 260,000
Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
Senior ML Inference Engineer — High-Performance LLM Serving
Senior ML Inference Engineer — High-Performance LLM Serving

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+2
AI/ML Systems Engineer - Neuron Inference
AI/ML Systems Engineer - Neuron Inference

Amazon • Seattle (WA)

On-site
USD 144,000 - 194,000
Senior ML Inference Engineer - Neuron Optimizations
Senior ML Inference Engineer - Neuron Optimizations

Annapurna Labs (U.S.) Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
RSUs
Paid time off
+1
Senior AI/ML Software Engineer: Inference on Trainium
Senior AI/ML Software Engineer: Inference on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
RSUs
Health insurance
401(k) matching
+1
Senior ML Inference Engineer - LLM Serving on Accelerators
Senior ML Inference Engineer - LLM Serving on Accelerators

Annapurna Labs • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+1
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000