Senior Forward Deployed Engineer (FDE) for AI and GenAI Inference Optimization

Advanced Micro Devices, Inc.; Riyadh; On-site; SAR 350,000 - 520,000; Full time

Job summary

Advanced Micro Devices, Inc. is seeking a Senior Forward Deployed Engineer to enable, optimize, and deploy GenAI inference workloads on AMD data center CPUs and GPUs.

You will bridge cutting-edge AI models with AMD hardware, delivering performance across the inference stack in a customer-facing role. You will collaborate with strategic partners to deploy advanced techniques, contribute to open-source frameworks, and leverage AI-assisted coding tools to accelerate development and debugging

Qualifications

• BS, MS, or PhD in Computer Science, Electrical Engineering, or a related field with 8+ years of experience.
• Deep expertise in GPU architecture and performance optimization with ROCm or CUDA.
• Strong Python and C++ skills; kernel development experience with Triton, HIP, or CUDA.
• Familiarity with LLM inference frameworks (vLLM, SGLang) and AI-assisted coding tools.

Responsibilities

• Enable and optimize LLM and multimodal model inference on AMD Instinct GPUs to meet performance targets.
• Optimize GenAI inference pipelines and manage tensor data and KV cache.
• Develop and tune low-level GPU kernels for attention, MoE, and GEMM operations.
• Profile workloads and deliver throughput/latency improvements across CPU/GPU boundaries.
• Contribute improvements to open-source frameworks and internal libraries; document best practices.

Skills

GPU architecture

Python

C++

Triton

HIP/CUDA

AI-assisted coding

LLM inference

Transformer/MoE

Profiling

Kernel development

Education

BS/MS/PhD in CS/EE or related field

Tools

ROCm

rocProfiler

ROCdebug-agent

vLLM

SGLang

ATOM

AITER

Job description

Senior Forward Deployed Engineer (FDE) for AI and GenAI Inference Optimization

About the Role

We are seeking a Senior Member of Technical Staff to join our Forward Deployed Engineering (FDE) team. In this customer-facing role, you will work directly with strategic partners and customers to enable, optimize, and deploy state-of-the-art GenAI inference workloads on AMD data center CPUs and GPUs (Instinct™ family). You will bridge the gap between cutting‑edge AI models and AMD hardware, driving competitive performance across the full inference stack.

Responsibilities

• Partner directly with customers to enable and optimize large language models (LLMs) and multimodal models on AMD Instinct GPUs, meeting committed performance and accuracy targets.
• Optimize GenAI inference pipelines on vLLM and SGLang, including PD disaggregation, expert parallelism (EP/wide-EP), tensor/data parallelism, speculative decoding, and KV cache management.
• Develop and tune low-level GPU kernels (Triton, HIP, composable kernels) for attention, MoE, GEMM, quantization, and normalization operations.
• Profile end-to-end workloads, identify bottlenecks across GPU/CPU boundaries, and deliver measurable throughput and latency improvements versus competitive targets.
• Enable advanced data types and techniques (FP8, MXFP4, sparse attention) with a focus on both performance and numerical accuracy.
• Debug complex runtime, stability, and accuracy issues in production environments; partner with core engineering teams to identify root causes and contribute fixes.
• Contribute optimizations back to open-source frameworks (vLLM, SGLang, ATOM, AITER) and internal libraries; document best practices and deliver production-ready artifacts to customers.
• Leverage AI-assisted coding tools and agentic workflows to accelerate development, debugging, optimization, and code review across the inference stack.

What You'll Bring

• BS, MS, or PhD in Computer Science, Electrical Engineering, or a related field, along with 8+ years of relevant experience.
• Deep expertise in GPU architecture and performance optimization, including hands‑on experience with AMD ROCm (or CUDA) and GPU kernel development.
• Strong proficiency in Python and C++, with experience developing and optimizing kernels using Triton, HIP, or CUDA.
• Experience with AI-assisted coding and agentic development tools (e.g., GitHub Copilot, Claude, Cursor, or equivalent) to enhance productivity in kernel development, large-scale codebase navigation, debugging, and framework integration.
• Experience working with LLM inference frameworks (vLLM, SGLang, or equivalent) and serving optimization techniques.
• Solid understanding of transformer and MoE architectures, quantization, and distributed inference strategies (TP, DP, EP, and related parallelism techniques).
• Proficiency with profiling and debugging tools (e.g., rocProfiler, ROCdebug-agent).

Nice to Have

• Experience optimizing frontier models (DeepSeek, Qwen, Kimi, MiniMax, GLM, etc.) in production environments.
• Track record of contributing to open-source AI inference frameworks.
• Experience integrating AI-driven automation into engineering workflows and developer tooling.
• Strong customer-facing communication skills and the ability to manage technical deliverables against committed timelines.

AMD is committed to building a diverse and inclusive workplace. We encourage candidates to apply even if their experience does not align perfectly with every qualification listed. If you are excited about this role and believe you can make an impact, we would welcome your application.

#LI-MH3

Benefits offered are described: AMD benefits at a glance

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.