GPU Kernel Engineer

Advanced Micro Devices, Inc.

Santa Clara (CA)

Vor Ort

USD 180.000 - 240.000

Vollzeit

vor 26 Stunden
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Advanced Micro Devices, Inc. (AMD) is seeking a skilled engineer to optimize and develop deep learning frameworks for AMD GPUs.

The role focuses on kernel performance, large-scale training and inference, and collaboration with internal GPU software teams and external open-source communities. The candidate will work with C++ and Python in Linux environments, with a strong emphasis on SGLang optimization, compiler/toolchain integration, and scalable distributed systems across heterogeneous

Qualifikationen

  • Bachelor’s degree (or working towards a Master’s) in CS/CE/EE or related field.
  • Strong programming skills in C++ and Python, with experience in Linux environments.
  • Experience with SGLang or similar LLM inference frameworks is highly preferred.
  • Familiarity with GPU architectures and optimization techniques.

Aufgaben

  • Optimize and develop deep learning frameworks for AMD GPUs, enhancing kernel performance and scaling across multi-GPU/multi-node systems.
  • Profile and tune large-scale training and inference models for AMD hardware.
  • Design and optimize high-performance GPU kernels using HIP, CUDA, or related tools.
  • Collaborate with GPU library and compiler teams to integrate kernel-level optimizations with full-stack goals.
  • Contribute to SGLang development and upstream contributions for AMD’s AI software ecosystem.
  • Tune distributed systems for scale-out/inference, and engage with open-source communities.

Kenntnisse

C++
Python
Linux
LLM optimization
debugging
profiling

Ausbildung

Bachelor’s degree in Computer Science/Engineering

Tools

HIP
CUDA
LLVM/MLIR
Triton
ROCm

Jobbeschreibung

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

THE ROLE:

As a core member of the team, you will play a pivotal role in optimizing and developing deep learning frameworks for AMD GPUs. Your work will be instrumental in enhancing GPU kernel performance, accelerating deep learning models, and enabling training and inference at scale across multi-GPU and multi-node systems. You will collaborate across internal GPU software teams and engage with open-source communities to integrate cutting-edge compiler technologies and drive upstream contributions that benefit AMD’s AI software ecosystem.

THE PERSON:

Skilled engineer with strong technical and analytical expertise in C++ development within Linux environments. The ideal candidate will thrive in both collaborative team settings and independent work, with the ability to define goals, manage development efforts, and deliver high-quality solutions. Strong problem-solving skills, a proactive approach, and a keen understanding of software engineering best practices are essential.

KEY RESPONSIBILITIES:
  • Optimize Deep Learning Frameworks: Enhance performance of frameworks like TensorFlow, PyTorch, and SGLang on AMD GPUs via upstream contributions in open-source repositories.
  • Develop and Optimize Deep Learning Models: Profile and tune large-scale training and inference models for optimal performance on AMD hardware.
  • GPU Kernel Development: Design, implement, and optimize high-performance GPU kernels using HIP, Triton, or other relevant tools for AI operator efficiency.
  • Collaborate with GPU Library and Compiler Teams: Work closely with internal compiler and GPU math library teams to integrate and align kernel-level optimizations with full-stack performance goals.
  • Contribute to SGLang Development: Support optimization, feature development, and scaling of the SGLang LLM framework across AMD GPU platforms.
  • Distributed System Optimization: Tune and scale performance across both multi-GPU (scale-up) and multi-node (scale-out) environments, including inference parallelism and collective communication strategies.
  • Open-Source Collaboration: Partner with external maintainers to understand framework needs, propose optimizations, and upstream contributions effectively.
  • Apply Engineering Best Practices: Leverage modern software engineering practices in debugging, profiling, test-driven development, and CI integration.
PREFERRED EXPERIENCE:
  • Strong Programming Skills: Proficient in C++ and/or Python, with demonstrated ability to debug, profile, and optimize performance-critical code.
  • SGLang and LLM Optimization: Hands‑on experience with SGLang or similar LLM inference frameworks is highly preferred.
  • Compiler and GPU Architecture Knowledge: Background in compiler design or familiarity with technologies like LLVM, MLIR, or ROCm is a plus.
  • Heterogeneous System Workloads: Experience running and scaling workloads on large‑scale, heterogeneous clusters (CPU + GPU) using distributed training or inference strategies.
  • AI Framework Integration: Experience contributing to or integrating optimizations into deep learning frameworks such as PyTorch or TensorFlow.
  • GPU Computing: Working knowledge of HIP, CUDA, or other GPU programming models; experience with GCN/CDNA architecture preferred.
ACADEMIC CREDENTIALS:
  • Bachelor’s and/or working towards a Master’s Degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal‑opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Sr. Software Development Engineer – GPU Kernel Development
Sr. Software Development Engineer – GPU Kernel Development

Advanced Micro Devices, Inc. • Santa Clara (CA)

Vor Ort
USD 180.000 - 240.000
Benefits at a glance
Senior GPU Kernel Development Engineer
Senior GPU Kernel Development Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 150.000 - 190.000
AMD Benefits
Software Design Engineer- GPU Kernel Optimization
Software Design Engineer- GPU Kernel Optimization

AMD • San Jose (CA)

Vor Ort
USD 150.000 - 230.000
Software Design Engineer - GPU Kernel Optimization
Software Design Engineer - GPU Kernel Optimization

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180.000 - 240.000
SeniorGPU Kernel Development Engineer
SeniorGPU Kernel Development Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

Vor Ort
USD 190.000 - 250.000
GPU Kernel Development Engineer - Fellow
GPU Kernel Development Engineer - Fellow

Advanced Micro Devices, Inc. • Austin (TX)

Vor Ort
USD 190.000 - 300.000
AMD benefits at a glance
Software Development Engineer - GPU Libraries
Software Development Engineer - GPU Libraries

Advanced Micro Devices, Inc • San Jose (CA)

Vor Ort
USD 150.000 - 230.000
AMD benefits
Senior GPU Performance Engineer - AI Workloads
Senior GPU Performance Engineer - AI Workloads

Advanced Micro Devices, Inc • Santa Clara (CA)

Vor Ort
USD 180.000 - 260.000
Software Engineer- GPU/AI/ML
Software Engineer- GPU/AI/ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

Vor Ort
USD 170.000 - 250.000
AMD Benefits
GPU Runtime and System Software Engineer - Fellow
GPU Runtime and System Software Engineer - Fellow

Advanced Micro Devices, Inc. • San Jose (CA)

Vor Ort
USD 180.000 - 280.000