Senior AI/ML Compiler Engineer — GPU Performance

Advanced Micro Devices, Inc.; San Jose (CA); Hybrid; USD 150,000 - 230,000; Full time

Job summary

AMD in San Jose is seeking a highly motivated PMTS AI/ML Compiler Engineer to drive compiler optimizations for AI workloads on AMD GPU platforms, intersecting MLIR/LLVM and ROCm. You will collaborate across architecture, kernel, runtime, and framework teams to deliver scalable performance improvements and robust ONNX runtime support.

The role demands strong C++ skills, GPU programming experience, and a passion for high-performance AI software.

Qualifications

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
• Strong C++ and object-oriented software development fundamentals.
• Hands-on GPU programming experience with HIP/CUDA or equivalent.

Responsibilities

• Work with AMD’s architecture specialists to improve future products.
• Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
• Develop scalable solutions that improve portability and performance across AMD GPU architectures.
• Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.
• Implement, validate, and maintain ONNX operators and microbenchmark test suites.
• Lead performance optimization efforts for AI training, fine-tuning, RL, and inference workloads on AMD GPUs.
• Design and implement graph-, kernel-, and runtime-level optimizations delivering measurable performance gains.
• Analyze workload characteristics and identify opportunities to improve compute efficiency, memory utilization, and communication overhead.
• Drive performance characterization and benchmarking across pre- and post-silicon environments.

Skills

C++

GPU programming

Performance optimization

Linux

Communication

Education

Bachelor's or Master's in CS/CE/EE

Tools

MLIR/LLVM

HIP

CUDA

Triton

Git

Job description

AMD in San Jose is seeking a highly motivated PMTS AI/ML Compiler Engineer to drive compiler optimizations for AI workloads on AMD GPU platforms, intersecting MLIR/LLVM and ROCm. You will collaborate across architecture, kernel, runtime, and framework teams to deliver scalable performance improvements and robust ONNX runtime support.

The role demands strong C++ skills, GPU programming experience, and a passion for high-performance AI software.