Engineering

Jobtailor; San Francisco (CA); On-site; USD 170,000 - 230,000; Full time

Benefits offered by this job

Equity

Comprehensive health insurance

Flexible PTO

Parental leave

401(k)

401(k)

Learning opportunities

Job summary

Baseten is seeking an Engineering Manager to lead our GPU Kernel Engineering team, directing the low-level CUDA work that accelerates Baseten's inference stack. This player-coach role combines hands-on kernel work with team leadership to maximize impact.

You will steer technical direction at the intersection of GPU architecture, ML systems, and production inference, while building processes and culture for a high-performing, distributed kernel team.

Qualifications

• Proven experience leading a team of GPU or ML systems engineers, with a track record of hiring and developing strong technical talent.
• Deep personal background in GPU kernel engineering with production CUDA kernels experience.
• Strong understanding of GPU architecture fundamentals: memory hierarchy, warp execution, tensor cores, occupancy tradeoffs, profiling methodology.
• Experience with NVIDIA GPU architectures (Hopper or Blackwell preferred) and the CUDA ecosystem.
• Demonstrated ability to set technical direction, prioritize a roadmap, and communicate clearly across engineering and leadership.

Responsibilities

• Lead, grow, and mentor a team of GPU kernel engineers; own hiring, performance, and career development.
• Set technical direction for the kernel roadmap, balancing short-term inference wins with long-term architectural investments.
• Partner with the Chief Scientist, VP Engineering, and peer leads to align kernel work with Baseten's broader inference stack strategy.
• Drive cross-functional collaboration between kernel team and Model Performance, Capacity, and Infrastructure teams.
• Establish and maintain a high technical bar for kernel quality, performance, and correctness.
• Review kernel designs and implementations with depth on GPU architecture decisions, memory hierarchy, and optimization strategies.

Skills

GPU kernel engineering

Team leadership

CUDA kernels

GPU architecture

Profiling & debugging

NVIDIA GPUs (Hopper/Blackwell)

Tools

Nsight Systems

Nsight Compute

Torch Profiler

Triton

CUTLASS

CuTe DSL

Job description

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

We're looking for an Engineering Manager to lead our GPU Kernel Engineering team, the group responsible for writing the low-level CUDA code that makes Baseten's inference stack faster than anyone else's. This is a player-coach role for someone who has spent years hands-on writing kernels and is now ready to multiply their impact by leading a team of elite GPU engineers.

You'll own the technical direction of a team working at the intersection of GPU architecture, ML systems, and production inference. Your engineers write CUDA kernels for GEMMs, attention mechanisms, and MoE routing, optimize at the warp and tensor-core level, and ship improvements that directly reduce latency and cost for the AI companies running their most critical workloads on Baseten.

This role is not for someone who wants to step away from the technical work. You'll be close enough to the code to credibly review it, set direction, and unblock your team, while also building the processes, culture, and roadmap that let a world-class kernel team operate at its best.

EXAMPLE INITIATIVES

Your team owns work like:

• Baseten Embeddings Inference: The fastest embeddings solution available
• The Baseten Inference Stack
• Driving model performance optimization

RESPONSIBILITIES

Team Leadership

• Lead, grow, and mentor a team of GPU kernel engineers; own hiring, performance, and career development
• Set technical direction for the kernel roadmap, balancing short-term inference wins with long-term architectural investments
• Partner closely with the Chief Scientist, VP Engineering, and peer engineering leads to align kernel work with Baseten's broader inference stack strategy
• Drive cross-functional collaboration between the kernel team and Model Performance, Capacity, and Infrastructure teams

Technical Direction

• Establish and maintain a high technical bar for kernel quality, performance, and correctness across the team's output
• Review kernel designs and implementations with enough depth to give meaningful feedback on GPU architecture decisions, memory hierarchy tradeoffs, and optimization strategies
• Guide the team's approach to profiling and bottleneck identification using tools like Nsight Systems, Nsight Compute, and Torch Profiler
• Stay current on the NVIDIA GPU ecosystem (Hopper, Blackwell, and beyond) and translate architectural advancements into team priorities

Execution & Culture

• Build the processes that allow a highly technical, distributed team to ship with velocity and rigor
• Represent the kernel team's work to senior leadership and external audiences including industry conferences
• Contribute to Baseten's open-source GPU library presence and technical brand

REQUIREMENTS

• Proven experience leading a team of GPU or ML systems engineers, with a track record of hiring and developing strong technical talent
• Deep personal background in GPU kernel engineering. You have written and shipped production CUDA kernels and can credibly engage with your team's work at a technical level
• Strong understanding of GPU architecture fundamentals: memory hierarchy, warp execution, tensor cores, occupancy tradeoffs, and profiling methodology
• Experience with NVIDIA GPU architectures (Hopper or Blackwell preferred) and the CUDA ecosystem
• Demonstrated ability to set technical direction, prioritize a roadmap, and communicate clearly across engineering and leadership

NICE TO HAVE

• Hands-on experience with Triton, CUTLASS, or CuTe DSL
• Background in LLM inference kernels: attention variants, GEMMs, quantization (FP8/FP4), MoE routing
• Open-source contributions to GPU libraries or inference frameworks
• Experience presenting technical work at NVIDIA GTC, MLSys, or similar venues

BENEFITS

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).