GPU Kernel Engineering Manager — CUDA & ML Systems Leader

Baseten; San Francisco (CA); On-site; USD 190,000 - 240,000; Full time

Benefits offered by this job

Equity

Comprehensive health insurance

Flexible PTO

Parental leave

401(k)

Job summary

Baseten is seeking an Engineering Manager to lead our GPU Kernel Engineering team, directing the low-level CUDA work that accelerates Baseten's inference stack. This player-coach role combines hands-on kernel work with team leadership to maximize impact.

You will steer technical direction at the intersection of GPU architecture, ML systems, and production inference, while building processes and culture for a high-performing, distributed kernel team.

Qualifications

• Proven experience leading a team of GPU or ML systems engineers, with a track record of hiring and developing strong technical talent.
• Deep personal background in GPU kernel engineering with production CUDA kernels experience.
• Strong understanding of GPU architecture fundamentals: memory hierarchy, warp execution, tensor cores, occupancy tradeoffs, profiling methodology.
• Experience with NVIDIA GPU architectures (Hopper or Blackwell preferred) and the CUDA ecosystem.
• Demonstrated ability to set technical direction, prioritize a roadmap, and communicate clearly across engineering and leadership.

Responsibilities

• Lead, grow, and mentor a team of GPU kernel engineers; own hiring, performance, and career development.
• Set technical direction for the kernel roadmap, balancing short-term inference wins with long-term architectural investments.
• Partner with the Chief Scientist, VP Engineering, and peer leads to align kernel work with Baseten's broader inference stack strategy.
• Drive cross-functional collaboration between kernel team and Model Performance, Capacity, and Infrastructure teams.
• Establish and maintain a high technical bar for kernel quality, performance, and correctness.
• Review kernel designs and implementations with depth on GPU architecture decisions, memory hierarchy, and optimization strategies.

Skills

GPU kernel engineering

Team leadership

CUDA kernels

GPU architecture

Profiling & debugging

NVIDIA GPUs (Hopper/Blackwell)

Tools

Nsight Systems

Nsight Compute

Torch Profiler

Triton

CUTLASS

CuTe DSL

Job description

Baseten is seeking an Engineering Manager to lead our GPU Kernel Engineering team, directing the low-level CUDA work that accelerates Baseten's inference stack. This player-coach role combines hands-on kernel work with team leadership to maximize impact.

You will steer technical direction at the intersection of GPU architecture, ML systems, and production inference, while building processes and culture for a high-performing, distributed kernel team.