Senior SDE, Cloud ML Orchestration & Training

Amazon Web Services (AWS); Bellevue (WA); On-site; USD 144,000 - 194,000; Full time

Job summary

Amazon.com Services LLC in Bellevue, WA is seeking a Software Development Engineer to design, build, and operate the core distributed systems that power Model Factory. You will own end-to-end components—from design through deployment and on-call support—working closely with ML scientists and platform teams.

You will contribute to orchestrations, SDKs, and scaffolding that enable scalable training, evaluation, and deployment at scale, with emphasis on reliability, performance, and customer impact.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of design or architecture experience for distributed systems.
• 1+ years of software development engineer or related experience.
• 1+ years of designing and developing large-scale distributed software using C#, C++, Java, or Perl.

Responsibilities

• Design, build, test, and operate services that orchestrate foundation-model data prep, training, evaluation, and deployment as contract-validated workflows.
• Own delivery of components end-to-end from design to deployment and on-call operations.
• Build/extend compute-backend integrations and job launchers across SageMaker, EMR, AWS Batch, Kubernetes/EKS.
• Improve resiliency and operability for long-running distributed jobs (checkpoint/resume, fault detection, retries, observability).
• Contribute to SDK, workflow orchestration, and schema/contract layer; help deploy with CDK infrastructure.
• Integrate containerized training/evaluation frameworks (e.g., PyTorch/FSDP, verl, NeMo/Megatron).
• Contribute to design discussions, write technical designs, uphold best practices (code reviews, testing, ops).
• Collaborate with ML scientists to translate training requirements into reliable, self-service platform capabilities; mentor interns/new engineers.

Skills

Software development

Design/architecture

OO design

Programming languages

Education

Bachelor's degree in Computer Science/Engineering/Math

Tools

Kubernetes

Ray

Slurm

AWS Batch

Job description

Amazon.com Services LLC in Bellevue, WA is seeking a Software Development Engineer to design, build, and operate the core distributed systems that power Model Factory. You will own end-to-end components—from design through deployment and on-call support—working closely with ML scientists and platform teams.

You will contribute to orchestrations, SDKs, and scaffolding that enable scalable training, evaluation, and deployment at scale, with emphasis on reliability, performance, and customer impact.