Senior AI Performance Architect — Scalable GPU Training

Advanced Micro Devices, Inc.; Austin (TX); Vor Ort; USD 180.000 - 240.000; Vollzeit

Benefits dieser Stelle

AMD Benefits

Zusammenfassung

Advanced Micro Devices, Inc. is seeking a Senior Engineer to lead teams shaping the next generation of AI infrastructure. You will define GPU architecture strategies and drive 2-3x performance gains in training and inference across large-scale ML systems.

You will collaborate across hardware and software groups, implement memory-efficient training, and advance multi-modal and transformer-based models at scale in a high-impact, office-based role in Austin, Texas.

Qualifikationen

• Extensive and Senior experience optimizing large-scale ML systems and GPU architectures.
• Deep expertise in CUDA programming, GPU memory hierarchies, and hardware-specific optimizations.
• Proven track record architecting distributed training systems handling large scale systems.
• Expert knowledge of transformer architectures, attention mechanisms, and model parallelism techniques.

Aufgaben

• Lead performance modeling and optimization for multi-trillion parameter LLM training/inference including Dense, Mixture of Experts (MoE) with multiple modalities (text, vision, speech)
• Model/optimize novel parallelization strategies across tensor, pipeline, context, expert and data parallel dimensions
• Architect memory-efficient training systems utilizing techniques like structured pruning, quantization (MX formats), continuous batching/chunked prefill, speculative decoding
• Incorporate and extend SOTA models such as GPT-4, Reasoning models (Deepseek-R1), and multi-modal architectures
• Collaborate with internal and external stakeholders/ML researchers to disseminate results and iterate at rapid pace.

Kenntnisse

Large-scale ML

GPU architectures

CUDA programming

Attention mechanisms

Model parallelism

Distributed training

Ausbildung

Bachelor's, MS/PhD in CS/EE

Tools

PyTorch

CUDA

TensorRT

OpenAI Triton

Jobbeschreibung

Advanced Micro Devices, Inc. is seeking a Senior Engineer to lead teams shaping the next generation of AI infrastructure. You will define GPU architecture strategies and drive 2-3x performance gains in training and inference across large-scale ML systems.

You will collaborate across hardware and software groups, implement memory-efficient training, and advance multi-modal and transformer-based models at scale in a high-impact, office-based role in Austin, Texas.