Open Source Software Engineer — ML Systems & AMD Hardware

Advanced Micro Devices; San Jose, Northern (CA, KY); Hybrid; USD 180,000 - 230,000; Full time

Job summary

Advanced Micro Devices is seeking an Open Source Software Engineer to build and optimize machine learning systems that integrate with AMD hardware. You will work at the intersection of open source AI software, GPU systems, and high-performance computing, bringing cutting-edge AI workloads to AMD platforms.

You will design, implement, test, and ship open source integrations with widely used AI systems, focusing on LLM inference, kernel optimization, and upstream contributions in collaborative

Qualifications

• Strong familiarity with LLM systems, inference workloads, compute, and optimization.
• Experience optimizing GPU kernels, particularly for AMD architectures.
• Ability to learn and adapt across kernel programming languages and models.

Responsibilities

• Develop and maintain open source integrations between ML/AI software and AMD hardware.
• Optimize kernels and critical execution paths for AMD GPUs.
• Profile workloads, identify performance bottlenecks, and implement optimizations.
• Develop kernel fusions and GPU execution pipelines.
• Adapt implementations across different kernel programming languages and environments.
• Collaborate with LLM inference systems and understand performance impacts of data layout and quantization.
• Contribute high-quality code upstream to open source projects.
• Write unit, integration, and performance tests.
• Build and maintain automated testing and validation infrastructure.
• Participate in code reviews with maintainers and contributors.

Skills

LLM workloads

GPU kernel optimization

Open source development

Performance profiling

Cross-layer optimization

Tools

Code review

Automated testing

CI

Upstream contribution

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology has the power to solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you're redesigning next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger— technology that moves the world forward. Join us and, together, we'll advance your career.

The Role

We are looking for an Open Source Software Engineer to build and optimize machine learning systems that integrate with AMD hardware. You will work at the intersection of open source AI software, GPU systems, and high-performance computing, helping bring cutting-edge AI workloads to AMD platforms.

You will design, implement, test, and ship open source integrations with widely used AI systems and frameworks. The role requires a strong understanding of modern LLM inference and compute, GPU kernel optimization, and the realities of developing software in collaborative open source communities.

This is an engineering role for someone who enjoys working close to the hardware while also contributing upstream to the software ecosystem.

The Person

You are a systems-oriented software engineer who understands how modern ML workloads map onto GPUs. You are comfortable moving between high-level ML frameworks and low-level kernels, and you enjoy investigating performance bottlenecks and turning them into measurable improvements.

You have:

• Strong familiarity with LLM systems, inference workloads, compute, and optimization.
• Experience optimizing GPU kernels, particularly for AMD architectures.
• The ability to learn and adapt across different kernel programming languages and programming models.
• A strong understanding of kernel fusion, GPU execution, and pipelined execution.
• An understanding of performance tradeoffs across compute, memory bandwidth, synchronization, and data movement.
• Familiarity with open source development practices, including code review, automated testing, CI, and upstream contribution.
• A willingness to work across layers of the stack, from ML models and frameworks down to GPU kernels and hardware-specific optimizations.
• Knowledge of graphics processor pipelines and experience with quantized data layouts or model quantization techniques are valuable additions.

Key Responsibilities

• Develop and maintain open source integrations between ML/AI software and AMD hardware.
• Optimize kernels and critical execution paths for AMD GPUs.
• Profile workloads, identify performance bottlenecks, and implement measurable optimizations.
• Develop and optimize kernel fusions and GPU execution pipelines.
• Adapt implementations across different kernel programming languages and GPU programming environments.
• Work with LLM inference systems and understand how model architecture, data layout, quantization, and execution strategy affect performance.
• Contribute high-quality code upstream to relevant open source projects.
• Write comprehensive unit, integration, and performance tests.
• Build and maintain automated testing and validation infrastructure.
• Participate in code reviews and collaborate with maintainers and contributors across the open source community.
• Investigate and resolve correctness and performance issues across the software and hardware stack.
• Document implementations, performance characteristics, and technical decisions for other developers.

What Success looks like

In this role, you will help make advanced AI workloads fast, reliable, and broadly accessible on AMD hardware. Success means not only producing high-performance implementations, but contributing them in a form that can be reviewed, tested, maintained, and adopted by the broader open source community.

Preferred Experience

Experience with one or more of the following technologies is a strong plus:

• vLLM
• SGLang
• llama.cpp
• ROCm
• CUDA
• Vulkan / SPIR-V
• Additional valuable experience includes:
• GPU kernel development and optimization.
• AMD GPU architecture and performance analysis.
• LLM inference and serving systems.
• Kernel fusion and pipelined GPU execution.