GPU Kernel Engineer: Accelerate Cutting-Edge AI

Baseten; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Baseten in the United States is seeking a GPU Kernel Engineer to advance AI acceleration. You will design high-performance kernels for ML workloads, targeting low-latency inference across production systems.

You will work with research teams to translate breakthroughs into optimized code, using CUDA C++ and advanced profiling tools. This role offers growth and impact in a fast-paced environment serving millions of users.

Qualifications

• Strong understanding of GPU architectures and parallel programming.
• Proficient in CUDA C++ and performance profiling tools.
• Experience with memory hierarchy and bandwidth optimization.
• Familiar with tensor cores and quantization strategies.

Responsibilities

• Design and implement high-performance GPU kernels for ML operations.
• Write and optimize CUDA/PTX code for matrix multiplies and attention.
• Apply memory coalescing, warp-level programming, and overlap optimization.
• Work with researchers to productionize advancements.
• Present technical contributions at industry conferences.

Skills

GPU architecture

CUDA C++

Performance profiling

Memory optimization

Parallel programming

Tensor cores

Tools

Nsight Systems

Nsight Compute

Torch Profiler

CUDA Toolkit

Job description

Baseten in the United States is seeking a GPU Kernel Engineer to advance AI acceleration. You will design high-performance kernels for ML workloads, targeting low-latency inference across production systems.

You will work with research teams to translate breakthroughs into optimized code, using CUDA C++ and advanced profiling tools. This role offers growth and impact in a fast-paced environment serving millions of users.