Senior ML Infrastructure Engineer - GenAI & Scale

Amazon Inc.; Seattle (WA); On-site; USD 168,000 - 227,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Inc. in Seattle seeks a senior ML infrastructure leader to own the LLM inference platform and drive scalable, reliable GenAI workloads across Amazon Ads.

You will shape the architecture for training and real-time serving, collaborating with applied scientists and cross-team partners to raise the bar on ML infrastructure. You should bring 5+ years in software design, leadership, and mentoring, with a track record of delivering production ML systems at scale.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Lead the development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale: define the technical strategy, evaluate tradeoffs and deliver production-ready solutions.
• Own the architectural direction of large-scale ML training and real-time inference systems, driving improvements in scalability, automation and efficiency across the organization.
• Partner with applied scientists to design and optimize end-to-end ML pipelines, from model training and evaluation through deployment and serving, so models perform reliably at massive scale.
• Influence technical direction beyond your team by establishing ML infrastructure best practices and contributing to cross-team architectural decisions.
• Make principled tradeoff decisions on complex, ambiguous problems in a fast-moving GenAI space, bringing clarity and delivering results independently.
• Mentor engineers across the team and be the technical resource others seek out for ML infrastructure expertise.

Skills

Professional software development

Programming experience

Architecture leadership

Mentor / tech lead

Education

Bachelor's degree in computer science or equivalent

Job description

Amazon Inc. in Seattle seeks a senior ML infrastructure leader to own the LLM inference platform and drive scalable, reliable GenAI workloads across Amazon Ads.

You will shape the architecture for training and real-time serving, collaborating with applied scientists and cross-team partners to raise the bar on ML infrastructure. You should bring 5+ years in software design, leadership, and mentoring, with a track record of delivering production ML systems at scale.