Foundation Models Engineer - AI/ML Systems & Optimization

Amazon Web Services (AWS); Houston (TX); On-site; USD 143,000 - 193,000; Full time

Job summary

Amazon Web Services, Inc. in Houston, TX is seeking an AI/ML Engineer to design and build efficient, stable foundation models for long-horizon agentic workloads, blending model development with systems and hardware optimization.

You will work with PyTorch, JAX, CUDA, and other accelerators to improve latency, throughput, and memory usage, profile bottlenecks, and develop evaluations for model reliability and long-horizon performance.

Qualifications

• 3+ years of building models for business applications.
• PhD or Master’s with 4+ years CS/CE/ML experience.
• Experience in patents or publications at top-tier peer-reviewed conferences or journals.
• Experience programming in Java, C++, Python or related language.
• Experience in algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Responsibilities

• Design, train, fine-tune, and evaluate custom foundation models.
• Improve model efficiency, stability, latency, throughput, and memory usage.
• Build models that support planning, tool use, memory, self-correction, and multi-step task execution.
• Optimize training and inference using CUDA, Triton, custom GPU kernels, and tensor operations.
• Profile and resolve compute, memory, communication, and distributed-training bottlenecks.
• Work with GPUs and specialized AI accelerators, including AWS Trainium and other custom tensor hardware.
• Develop evaluations for model reliability and long-horizon agent performance

Skills

Machine learning

Deep learning

Transformers

Foundation models

PyTorch

JAX

GPU architecture

CUDA

Model parallelism

Distributed training

Education

PhD in ML/CS/EE preferred

Master's degree in CS/CE/ML

Tools

Python

Java

C++

Unix/Linux

PyTorch

JAX

CUDA

Triton

Tensor operations

Job description

Amazon Web Services, Inc. in Houston, TX is seeking an AI/ML Engineer to design and build efficient, stable foundation models for long-horizon agentic workloads, blending model development with systems and hardware optimization.

You will work with PyTorch, JAX, CUDA, and other accelerators to improve latency, throughput, and memory usage, profile bottlenecks, and develop evaluations for model reliability and long-horizon performance.