Staff ML Engineer: Production SageMaker & Trainium

Robots & Pencils

United States

On-site

USD 140,000 - 200,000

Full time

9 days ago

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Robots & Pencils is seeking an engineer who can operate and train models on Amazon SageMaker with AWS Trainium, integrating from hardware-level concepts through PyTorch to production pipelines. You’ll work hands-on beyond APIs, shaping training requests at the accelerator and compiler level.

Strong PyTorch expertise, production experience with SageMaker, and comfort near the hardware layer are required. You’ll diagnose issues, optimize distributed training, and collaborate with client teams to

Qualifications

Hands-on PyTorch experience with distributed or multi-device training.
Production experience with Amazon SageMaker for training and inference.
Comfort working close to accelerator hardware: understanding compilation and device behavior.

Responsibilities

Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute.
Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs).
Diagnose training run issues that arise from hardware, not just the model, distinguishing data or code problems from compiler or device-level ones.
Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end.
Tune distributed training runs for throughput and cost on SageMaker's training infrastructure.
Work directly with client and internal engineering teams to scope and deliver real production training workloads.