Foundation Models AI/ML Engineer – Systems & GPU Optimized

Amazon Science; Santa Clara (CA); On-site; USD 172,000 - 222,000; Full time

Job summary

Amazon is seeking an AI/ML Engineer to build efficient foundation models for long-horizon agentic workloads, blending model development with systems and hardware optimization in Santa Clara, California.

You will design, train, and evaluate models, optimize performance on GPUs and AWS accelerators, and contribute to scalable AI infrastructure across teams.

This role demands strong ML background, experience with PyTorch/JAX, and familiarity with distributed training and high-performance computing.

Qualifications

• Strong background in machine learning, deep learning, transformers, and foundation models.
• Experience with PyTorch, JAX, or similar frameworks.
• Experience training, fine-tuning, or serving large-scale models.
• Knowledge of GPU architecture, CUDA, Triton, custom kernels, or hardware-aware optimization.
• Familiarity with distributed training and model parallelism.
• Experience with AWS Trainium, Inferentia, Neuron SDK, TPUs, or other custom accelerators is preferred.
• PhD in machine learning, computer science, electrical engineering, or a related field is preferred.

Responsibilities

• Design, train, fine-tune, and evaluate custom foundation models.
• Improve model efficiency, stability, latency, throughput, and memory usage.
• Build models that support planning, tool use, memory, self-correction, and multi-step task execution.
• Optimize training and inference using CUDA, Triton, custom GPU kernels, and tensor operations.
• Profile and resolve compute, memory, communication, and distributed-training bottlenecks.
• Work with GPUs and specialized AI accelerators, including AWS Trainium and other custom tensor hardware.
• Develop evaluations for model reliability and long-horizon agent performance.

Skills

Machine learning

Deep learning

Transformers

Foundation models

PyTorch

JAX

Model training

Distributed training

GPU architecture

CUDA

Education

PhD in ML/CS/EE

Master's in CS/CE/ML

Tools

CUDA

Triton

Custom kernels

Tensor operations

AWS Trainium

Job description

Amazon is seeking an AI/ML Engineer to build efficient foundation models for long-horizon agentic workloads, blending model development with systems and hardware optimization in Santa Clara, California.

You will design, train, and evaluate models, optimize performance on GPUs and AWS accelerators, and contribute to scalable AI infrastructure across teams.

This role demands strong ML background, experience with PyTorch/JAX, and familiarity with distributed training and high-performance computing.