Senior Software Engineer — GenAI & ML Acceleration

Amazon Web Services (AWS); New York (NY); On-site; USD 185,000 - 250,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

RSUs

Job summary

Amazon Annapurna Labs (U.S.) Inc. is looking for a senior software leader to drive AI workloads on AWS Neuron and GenAI tooling in NYC. You will lead a team building AI agents and optimizers for ML silicon adoption and collaborate with internal and external partners.

Join a fast-moving team focused on research, design, and delivery across the stack, from compiler techniques to model optimization, delivering scalable ML capabilities for AWS customers.

Qualifications

• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Experience as a mentor, tech lead or leading an engineering team
• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• Hands‑on technical experience working in the Generative AI space
• Excellent written and verbal communication skills with the ability to present complex technical information concisely to executives and non-technical leaders
• Experience in ML compilers, production coding agents, GenAI model architecture, model training, neural network optimization, or alternatively applied math

Responsibilities

• Research implementations that deliver the best possible experiences for customers.
• Deliver on goals to improve the time and effort it takes to port and optimize Machine Learning workloads on Neuron.
• Solve challenging technical problems, often ones not solved before, at every layer of the stack
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Build high-quality, highly available, always-on products.
• Potentially contribute intellectual property through patents
• Assist in the career development of others, actively mentoring individuals and the community on advanced technical issues and helping managers guide the career growth of their team members.
• Exert technical influence over the team, increasing their productivity and effectiveness by sharing your deep knowledge and experience.

Job description

Amazon Annapurna Labs (U.S.) Inc. is looking for a senior software leader to drive AI workloads on AWS Neuron and GenAI tooling in NYC. You will lead a team building AI agents and optimizers for ML silicon adoption and collaborate with internal and external partners.

Join a fast-moving team focused on research, design, and delivery across the stack, from compiler techniques to model optimization, delivering scalable ML capabilities for AWS customers.