SeniorGPU Kernel Development Engineer

Advanced Micro Devices, Inc.; San Jose (CA); On-site; USD 190,000 - 250,000; Full time

Job summary

Advanced Micro Devices, Inc. (AMD) seeks a senior technical contributor to design, develop, and optimize high-performance GPU kernels for LLM and ML workloads.

You will analyze bottlenecks and craft architecture-aware optimizations to boost compute efficiency and memory bandwidth on AMD GPUs. The role involves close collaboration with GPU architecture, compiler, library, and framework teams to deliver scalable solutions across current and next-generation platforms.

Qualifications

• Strong C++ and parallel programming skills.
• Deep understanding of GPU compute, memory hierarchy, and bottlenecks.
• Experience developing and optimizing GPU kernels with HIP/CUDA or similar.
• Analytical mindset with attention to detail; able to work independently.

Responsibilities

• Architect and optimize AI workloads, including LLMs and quantized models for AMD GPUs.
• Design, implement, profile, and optimize GPU kernels for high hardware utilization.
• Conduct deep performance characterization across compute, memory, caching, and synchronization.
• Advance compiler/code-generation techniques using LLVM/MLIR for portable GPU performance.
• Explore AI-assisted development tools for code generation, debugging, and profiling.

Skills

C++ programming

GPU compute

Performance analysis

CUDA

HIP

LLVM/MLIR

Analytical/problem solving

Education

Bachelor's or Master's in electrical or computer engineering

Tools

CUDA

HIP

C/C++

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou'redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger- technologythat moves the world forward.Join us and, together, we'll advance your career.

THE ROLE:

As a senior technical member of the team, you will play a key role in designing, developing, and optimizing high-performance GPU kernels for LLM and other ML models. You will analyze performance bottlenecks and develop architecture-aware optimizations to maximize compute efficiency, memory bandwidth utilization, and overall GPU performance. You will also collaborate closely with GPU architecture, compiler, library, and framework teams to develop scalable solutions and advance GPU performance across current and next-generation platforms.

THE PERSON:

The ideal candidate has strong experience in GPU programming, performance analysis and system software development. You will provide technical leadership, guiding teams and driving projects/initiatives independently. You will define goals, scope, and own development efforts while collaborating effectively within a high-performing team.

KEY RESPONSIBILITIES:

• Architect and Optimize AI Workloads: Lead the optimization of LLMs, quantized models, and emerging AI workloads for AMD GPU architectures.
• Develop High-Performance GPU Kernels: Design, implement, profile, and optimize GPU kernels, with a strong focus on maximizing hardware utilization and application performance.
• Drive Performance Analysis: Perform deep performance characterization across compute, memory bandwidth, cache hierarchy, synchronization, kernel scheduling, and execution efficiency to identify and eliminate bottlenecks.
• Advance Compiler and Code-Generation Technologies: Develop compiler-level optimizations and code-generation techniques using LLVM, MLIR, and related technologies to achieve portable and scalable GPU performance.
• Innovate with AI-Assisted Development: Apply AI techniques to create next-generation tools for code generation, debugging, performance analysis, kernel optimization, and engineering productivity.

PREFERRED EXPERIENCE:

• Strong C++ skills
• Strong understanding of GPU compute, memory hierarchy, cache behavior, synchronization, and performance bottlenecks.
• Strong experience developing and optimizing GPU kernels using HIP, CUDA, C/C++, or similar technologies.
• Strong analytical/problem-solving skills and pronounced attention to details
• Must be a self-starter, and able to independently drive tasks to completion

ACADEMIC CREDENTIALS:

• Bachelors or Masters degree in electrical or computer engineering

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here.

This posting is for an existing vacancy.