Senior AI/ML Engineer for Custom AI Accelerators

Amazon; Seattle (WA); On-site; USD 168,000 - 227,000; Full time

Job summary

Amazon in Seattle, WA seeks a Sr. Software Engineer – AI/ML for AWS Neuron to accelerate ML workloads on custom AI accelerators. You will design, optimize, and deploy high-performance ML models across multi-GPU and multi-node environments.

You will own performance tuning, work with open-source ecosystems, and collaborate with cross-functional teams to push the boundaries of AI acceleration for GenAI workloads.

Qualifications

• Bachelor's degree in a field related to software engineering.
• 5+ years of professional software development experience.
• Knowledge of Python and/or C++ programming.
• 5+ years of leading design or architecture of large-scale systems.
• Experience with debugging, profiling, and software engineering best practices.

Responsibilities

• Design, develop, and optimize ML models on custom AI accelerators.
• Participate in all stages of ML system lifecycle and distributed architectures.
• Build infrastructure to onboard multiple models with diverse architectures.
• Develop high-performance kernels for ML operations on Neuron hardware.
• Collaborate with customers to optimize their ML workloads on AWS accelerators.
• Lead optimization efforts and mentor engineers on performance.

Skills

Python

C++

Design/Architecture

Debugging/Profiling

Memory Management

Parallel Computing

PyTorch

NCCL

CUDA/Triton kernels

Education

Bachelor's degree

Master's degree (preferred)

Tools

PyTorch

CUDA

Triton

NCCL

Job description

Amazon in Seattle, WA seeks a Sr. Software Engineer – AI/ML for AWS Neuron to accelerate ML workloads on custom AI accelerators. You will design, optimize, and deploy high-performance ML models across multi-GPU and multi-node environments.

You will own performance tuning, work with open-source ecosystems, and collaborate with cross-functional teams to push the boundaries of AI acceleration for GenAI workloads.