ML Training Platform Lead (Distributed Systems)

Amazon Inc.; Santa Clara (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Amazon Inc. in Santa Clara, CA, is seeking a Software Development Manager to lead the SageMaker Training team that builds services for fine-tuning and post-training models at scale. You will hire and grow engineers, set technical direction with senior engineers and PMs, and own the roadmap and production service.

You'll work with PyTorch and frameworks like Verl, FSDP, Megatron, and vLLM, advocating for reliability, cost efficiency, and performance across large accelerator fleets.

Responsibilities

• Own the team's charter and roadmap, and defend its tradeoffs with senior leadership.
• Hire, develop and retain engineers in a specialized field with a scarce talent pool.
• Set technical direction with your senior engineers, applied scientists and product managers.
• Decide what the team builds, and what it does not.
• Turn new post-training techniques into supported customer capabilities on a predictable schedule.
• Own the service in production, including on-call health, availability and operational metrics.
• Improve training throughput and cost per run across large accelerator fleets.

Job description

Amazon Inc. in Santa Clara, CA, is seeking a Software Development Manager to lead the SageMaker Training team that builds services for fine-tuning and post-training models at scale. You will hire and grow engineers, set technical direction with senior engineers and PMs, and own the roadmap and production service.

You'll work with PyTorch and frameworks like Verl, FSDP, Megatron, and vLLM, advocating for reliability, cost efficiency, and performance across large accelerator fleets.