GPU Kernel Engineer for High-Performance AI Inference

Baseten; San Francisco (CA); On-site; USD 180,000 - 360,000; Full time

Benefits offered by this job

Competitive compensation, including equity

100% coverage of medical, dental, and vision insurance

Flexible PTO policy

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Job summary

Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding of GPU architecture and proficient coding skills in C++. The position offers competitive compensation, including equity, with a full benefits package including 100% medical coverage for employees and their dependents.

Qualifications

• Strong understanding of GPU architecture and programming paradigms.
• Proficient in C++ and GPU performance profiling tools.
• Knowledge of numerical precision and quantization strategies.

Responsibilities

• Design and implement high-performance GPU kernels for key ML operations.
• Write and optimize code using CUDA and architecture‑specific techniques.
• Identify and resolve performance bottlenecks using profiling tools.

Skills

Strong understanding of GPU architecture

Proficient in C++

Experience with CUDA C++ API

Knowledge of memory access patterns

Tools

CUDA

Nsight Systems

Torch Profiler

Job description

Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding of GPU architecture and proficient coding skills in C++. The position offers competitive compensation, including equity, with a full benefits package including 100% medical coverage for employees and their dependents.