Principal Engineer: AI Training & Inference on Neuron

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 230,000 - 311,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) is seeking a Principal Engineer for Annapurna Labs Training and Inference to drive AI model performance across pre-training, post-training, and inference on Trainium. You will write code, own the forward and backward paths, and influence across the Neuron stack and partner teams.

You will lead with deep hands‑on expertise in one area, mentor senior engineers, and shape architecture decisions that boost model performance, scale, and cost efficiency at customer scale on

Qualifications

• 10+ years of non‑internship professional software development experience.
• 7+ years with distributed training or RL systems at scale; strong C/C++ and Python; experience with AI/ML model execution, inference serving, or compiler optimization; and technical leadership/mentorship of engineering teams.

Responsibilities

• Drive AI model performance across the lifecycle on AWS Trainium including pre-training, post-training, alignment, and inference serving.
• Write code and own forward/backward paths; make binding technical decisions while influencing across the Neuron organization and partner teams.
• Lead technically on demanding cross‑functional projects spanning pre‑training, post‑training, and inference; mentor senior engineers and raise the technical bar.

Skills

Distributed training

RL systems

C/C++

Python

AI/ML model execution

Inference serving

Compiler optimization

Technical leadership

Mentorship

Team collaboration

Tools

JAX

PyTorch/XLA

TRL

veRL

NeMo‑Aligner

Ray

Job description

Amazon Web Services (AWS) is seeking a Principal Engineer for Annapurna Labs Training and Inference to drive AI model performance across pre-training, post-training, and inference on Trainium. You will write code, own the forward and backward paths, and influence across the Neuron stack and partner teams.

You will lead with deep hands‑on expertise in one area, mentor senior engineers, and shape architecture decisions that boost model performance, scale, and cost efficiency at customer scale on