Foundation Models Scientist: AI Systems & Optimization

Amazon; Santa Clara (CA); On-site; USD 172,000 - 222,000; Full time

Job summary

Amazon Web Services, Inc. is seeking an AI/ML Engineer to design and optimize foundation models for long-horizon agentic workloads. The role blends model development with system and hardware optimization in a high-performance compute environment.

You will train, fine-tune, and evaluate models using PyTorch/JAX, adapt for GPUs and custom accelerators, and tackle latency, memory, and scalability challenges. Collaboration with diverse teams across AWS is expected.

Qualifications

• 3+ years of building models for business application experience.
• PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience.
• Experience in patents or publications at top-tier peer-reviewed conferences or journals.
• Experience programming in Java, C++, Python or related language; algorithms and data structures; numerical optimization; data mining; parallel and distributed computing; high-performance computing.

Responsibilities

• Design, train, fine-tune, and evaluate custom foundation models.
• Improve model efficiency, stability, latency, throughput, and memory usage.
• Build models that support planning, tool use, memory, self-correction, and multi-step task execution.
• Optimize training and inference using CUDA, Triton, custom GPU kernels, and tensor operations.
• Profile and resolve compute, memory, communication, and distributed-training bottlenecks.
• Work with GPUs and specialized AI accelerators, including AWS Trainium and other custom tensor hardware.
• Develop evaluations for model reliability and long-horizon agent performance.

Skills

Machine learning

Deep learning

Transformers

Foundation models

PyTorch

JAX

CUDA

Distributed training

Hardware optimization

Education

PhD in ML/CS/EE

MS in CS/CE/ML

Tools

AWS Trainium

Inferentia

Neuron SDK

TPUs

Job description

Amazon Web Services, Inc. is seeking an AI/ML Engineer to design and optimize foundation models for long-horizon agentic workloads. The role blends model development with system and hardware optimization in a high-performance compute environment.

You will train, fine-tune, and evaluate models using PyTorch/JAX, adapt for GPUs and custom accelerators, and tackle latency, memory, and scalability challenges. Collaboration with diverse teams across AWS is expected.