Sr. Machine Learning Engineer

Amazon Inc.; New York (NY); On-site; USD 193,000 - 227,000; Full time

Benefits offered by this job

Health insurance

Life & AD&D insurance

Supplemental life plans

Employee assistance program (EAP)

Mental health support

Flexible spending accounts

Adoption and surrogacy reimbursement

401(k) matching

Paid time off

Parental leave

Sign-on payments

RSUs

Job summary

Amazon Inc. in New York, NY is seeking a Sr. Machine Learning Engineer to shape ML infrastructure and architecture for ad relevance across training, real-time inference, and GenAI workloads.

The role is onsite in New York, offering leadership in GenAI-scale ML systems and collaboration with applied scientists. You will lead LLM inference infrastructure, drive architectural direction for scalable training and real-time serving, and mentor engineers.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years leading design or architecture work, including design patterns, reliability, and scaling of new and existing systems.
• Experience as a mentor, tech lead, or leading an engineering team.
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Bachelor's degree in computer science or equivalent.

Responsibilities

• Lead development of LLM inference infrastructure for GenAI workloads at Amazon Ads scale, defining strategy and delivering production-ready solutions.
• Own architectural direction for large-scale ML training and real-time inference systems, driving scalability, automation, and efficiency.
• Partner with applied scientists to design and optimize end-to-end ML pipelines, from training and evaluation through deployment and serving at scale.
• Establish ML infrastructure best practices and contribute to cross-team architectural decisions to influence direction beyond the team.
• Make principled tradeoff decisions for complex problems in a fast-moving GenAI environment, delivering results independently.
• Mentor engineers and serve as a technical resource for ML infrastructure expertise.

Skills

Software development

Programming

Leadership experience

Mentoring

SDLC

Bachelor's degree

Education

Bachelor's degree in computer science or equivalent

Job description

Work as a Sr. Machine Learning Engineer on Amazon Ads’ Ad Response Prediction team, shaping ML infrastructure and architecture for ad relevance across training, real-time inference, and LLM-based GenAI workloads in New York, NY (onsite).

Responsibilities

• Lead development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale, including defining technical strategy, evaluating tradeoffs, and delivering production-ready solutions
• Own architectural direction for large-scale ML training and real-time inference systems, driving scalability, automation, and efficiency improvements across the organization
• Partner with applied scientists to design and optimize end-to-end ML pipelines, covering model training and evaluation through deployment and serving at massive scale
• Establish ML infrastructure best practices and contribute to cross-team architectural decisions to influence technical direction beyond your immediate team
• Make principled tradeoff decisions for complex, ambiguous problems in a fast-moving GenAI environment, delivering results independently
• Mentor engineers across the team and serve as a technical resource for ML infrastructure expertise

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming experience with at least one software programming language
• 5+ years leading design or architecture work, including design patterns, reliability, and scaling of new and existing systems
• Experience as a mentor, tech lead, or leading an engineering team
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
• Bachelor's degree in computer science or equivalent

Compensation

• USD 193,300 - 227,400 per year

Benefits

• Comprehensive benefits, including health insurance (medical, dental, vision, prescription), Basic Life & AD&D insurance, and option for Supplemental life plans
• EAP, Mental Health Support, Medical Advice Line
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments
• Restricted stock units (RSUs)