Senior ML Inference Engineer — LLMs on Neuron

Amazon.com Services LLC

Seattle (WA)

On-site

USD 168,000 - 227,000

Full time

4 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon.com Services LLC's AWS Neuron team is seeking a senior software engineer to advance the ML inference stack on Inferentia and Trainium chips. This role focuses on optimizing core building blocks like Attention, MLP, Quantization, and Mixture of Experts, working with chip architects, compiler, and runtime engineers to deliver high performance and accuracy.

The team emphasizes mentorship and knowledge sharing.

Qualifications

5+ years of non-internship professional software development experience.
5+ years of programming with at least one software programming language experience.
5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
Experience as a mentor, tech lead or leading an engineering team.
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
Bachelor's degree in computer science or equivalent.

Responsibilities

Adapt latest research in LLM optimization to Neuron chips to extract best performance from both open source as well as internally developed models.
Working across teams and organizations is key.