GPU Performance Engineer for AMD ROCm AI Inference

MindSource; San Francisco (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

MindSource is seeking an experienced GPU Performance Engineer to optimize vLLM on AMD ROCm-based GPUs. You will focus on GPU kernel development, memory layout, and low-level performance tuning to push inference throughput.

You will collaborate with open-source AI infrastructure and contribute to performance benchmarks, profiling, and kernel fusion techniques, helping scale vLLM across AMD GPUs in production environments.

Qualifications

• Experience optimizing GPU kernels for AI/ML workloads.
• Strong knowledge of LLM inference techniques and GPU execution.
• Ability to profile, benchmark, and tune performance across AMD ROCm.
• Familiarity with attention, GEMM, KV cache, or fused kernels.

Responsibilities

• Develop and optimize GPU kernels for vLLM on AMD ROCm.
• Profile, benchmark, and tune inference performance at scale.
• Collaborate with open-source AI infra to improve kernel implementations.

Skills

GPU kernel dev

LLM inference optimization

Profiling & benchmarking

GPU architecture & memory

Attention / GEMM / KV cache

Tools

ROCm

Triton

PyTorch

Job description

MindSource is seeking an experienced GPU Performance Engineer to optimize vLLM on AMD ROCm-based GPUs. You will focus on GPU kernel development, memory layout, and low-level performance tuning to push inference throughput.

You will collaborate with open-source AI infrastructure and contribute to performance benchmarks, profiling, and kernel fusion techniques, helping scale vLLM across AMD GPUs in production environments.