Senior AI Systems Architect for Trainium Inference

Amazon Inc.

Seattle (WA)

On-site

USD 200,000 - 271,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
Parental leave

Job summary

Amazon's Annapurna Labs AWS Neuron team seeks a Principal Engineer to advance AI model performance on Trainium. You will own the end‑to‑end path from pre‑training through alignment to inference serving, with deep hands‑on experience and broad architectural influence.

You will collaborate with EC2, EKS, VPC, Bedrock and ML customers to ship scalable, cost‑efficient serving, shaping technical standards across chip, compiler, runtime and cloud layers. Seattle‑area leadership is part of the role.

Qualifications

  • 10+ years of non‑internship software development experience.
  • 7+ years with distributed training or RL systems at scale; strong C/C++ and Python; future leadership experience.
  • Experience mentoring and guiding engineering teams.

Responsibilities

  • Drive AI model performance across pre-training, post-training and inference for Trainium.
  • Write code for forward/backward paths and make binding technical decisions.
  • Influence across teams and mentor senior engineers while aligning with business goals.

Skills

Software development
Distributed training
C/C++
Python
Technical leadership

Job description

Amazon's Annapurna Labs AWS Neuron team seeks a Principal Engineer to advance AI model performance on Trainium. You will own the end‑to‑end path from pre‑training through alignment to inference serving, with deep hands‑on experience and broad architectural influence.

You will collaborate with EC2, EKS, VPC, Bedrock and ML customers to ship scalable, cost‑efficient serving, shaping technical standards across chip, compiler, runtime and cloud layers. Seattle‑area leadership is part of the role.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Engineer: AI Training & Inference on Trainium
Principal Engineer: AI Training & Inference on Trainium

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 200,000 - 271,000
Principal Engineer: AI Training & Inference on Neuron
Principal Engineer: AI Training & Inference on Neuron

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 230,000 - 311,000
Health insurance
RSUs
401(k) matching
+2
Principal Engineer: AI Model Performance for Trainium/Neuron
Principal Engineer: AI Model Performance for Trainium/Neuron

Amazon • Cupertino (CA)

On-site
USD 230,000 - 311,000
RSU program
Senior AI/ML Software Engineer: Inference on Trainium
Senior AI/ML Software Engineer: Inference on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
RSUs
Health insurance
401(k) matching
+1
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
AI/ML Software Engineer — Trainium Distributed Training
AI/ML Software Engineer — Trainium Distributed Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
AI/ML Systems Engineer - Neuron Inference
AI/ML Systems Engineer - Neuron Inference

Amazon • Seattle (WA)

On-site
USD 144,000 - 194,000
Senior AI/ML Software Engineer - High-Perf Inference
Senior AI/ML Software Engineer - High-Perf Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior AI Inference SDK Lead (Trainium/Inferentia)
Senior AI Inference SDK Lead (Trainium/Inferentia)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 253,000 - 342,000
Stock options / RSUs
Health insurance
401(k) matching
+2
Senior AI/ML Inference Engineer (Neuron)
Senior AI/ML Inference Engineer (Neuron)

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off