SDE II: SageMaker Training Platform

Amazon; Bellevue (WA); On-site; USD 144,000 - 194,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

Amazon's SageMaker AI Training Job team in Bellevue, WA is seeking a Software Development Engineer to design, build, and operate services that orchestrate data preparation, training, evaluation, and deployment for large-scale machine learning workloads.

You will own end-to-end components, improve resiliency, contribute to SDK and CDK infrastructure, and collaborate with ML scientists to translate training requirements into reliable, self-service platform capabilities.

Qualifications

• 3+ years of non-internship professional software development experience.
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Responsibilities

• Design, build, test, and operate services that orchestrate foundation-model data preparation, training, evaluation, and deployment as reliable, contract-validated workflows.
• Own delivery of individual components end-to-end — from design and implementation through deployment, monitoring, and on-call operations.
• Build and extend compute-backend integrations and job launchers — submitting, monitoring, and recovering large-scale training jobs across SageMaker (Training/Processing), and AWS Batch.
• Improve the platform's resiliency and operability for long-running distributed jobs — checkpoint/resume, fault detection and recovery, retries, and observability.
• Contribute to the SDK, workflow orchestration, and schema/contract layer that teams use to declare and run jobs, and to the CDK infrastructure that deploys the platform.
• Integrate containerized training and evaluation frameworks (e.g., PyTorch/FSDP, verl, NeMo/Megatron) into the platform's task and recipe model.
• Contribute to design and architecture discussions, write clear technical designs, and uphold engineering best practices.
• Collaborate with ML scientists and internal customers to translate training requirements into reliable, self-service platform capabilities, and help onboard and mentor interns and new engineers.

Skills

Software development

Distributed systems

C++

Java

Python

OO design

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, or related field

Tools

PyTorch

Megatron-LM

NeMo

Docker

Kubernetes

CDK

Job description

Amazon's SageMaker AI Training Job team in Bellevue, WA is seeking a Software Development Engineer to design, build, and operate services that orchestrate data preparation, training, evaluation, and deployment for large-scale machine learning workloads.

You will own end-to-end components, improve resiliency, contribute to SDK and CDK infrastructure, and collaborate with ML scientists to translate training requirements into reliable, self-service platform capabilities.