Senior GenAI Inference Engineer (FDE) AI Optimization

AMD; Riyad Al Khabra; Sur place; SAR 400 000 - 560 000; Plein temps

Résumé du poste

AMD is seeking a Senior Member of Technical Staff for its Forward Deployed Engineering team. You will enable and optimize state-of-the-art GenAI inference workloads on AMD Instinct GPUs, bridging AI models with hardware to achieve competitive performance.

You will work directly with customers, develop low-level kernels, and contribute to open-source frameworks, while leveraging AI-assisted coding tools to accelerate delivery.

Qualifications

• 8+ years of relevant experience in GPU architecture and performance optimization.
• Hands-on experience with AMD ROCm (or CUDA) and GPU kernel development.
• Strong Python and C++ skills with kernel development experience.

Responsabilités

• Partner with customers to enable and optimize large language models and multimodal models on AMD Instinct GPUs, meeting performance and accuracy targets.
• Optimize GenAI inference pipelines and tensor/data parallelism strategies.
• Develop and tune low-level GPU kernels for attention, MoE, GEMM, and quantization.
• Profile end-to-end workloads and deliver throughput/latency improvements vs. targets.
• Contribute optimizations back to open-source frameworks and internal libraries; document best practices.

Connaissances

GPU optimization

Python

C++

AI-assisted coding

LLM inference

Kernels development

Profiling

Formation

BS/MS/PhD in CS/EE

Outils

Triton

HIP

CUDA

rocProfiler

Description du poste

AMD is seeking a Senior Member of Technical Staff for its Forward Deployed Engineering team. You will enable and optimize state-of-the-art GenAI inference workloads on AMD Instinct GPUs, bridging AI models with hardware to achieve competitive performance.

You will work directly with customers, develop low-level kernels, and contribute to open-source frameworks, while leveraging AI-assisted coding tools to accelerate delivery.