GPU Kernel Engineer for High-Performance AI Inference

Baseten

San Francisco (CA)

On-site

USD 180,000 - 360,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
Paid parental leave
Fertility and family-building stipend
Company-facilitated 401(k)

Job summary

Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding of GPU architecture and proficient coding skills in C++. The position offers competitive compensation, including equity, with a full benefits package including 100% medical coverage for employees and their dependents.

Qualifications

  • Strong understanding of GPU architecture and programming paradigms.
  • Proficient in C++ and GPU performance profiling tools.
  • Knowledge of numerical precision and quantization strategies.

Responsibilities

  • Design and implement high-performance GPU kernels for key ML operations.
  • Write and optimize code using CUDA and architecture‑specific techniques.
  • Identify and resolve performance bottlenecks using profiling tools.

Skills

Strong understanding of GPU architecture
Proficient in C++
Experience with CUDA C++ API
Knowledge of memory access patterns

Tools

CUDA
Nsight Systems
Torch Profiler

Job description

Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding of GPU architecture and proficient coding skills in C++. The position offers competitive compensation, including equity, with a full benefits package including 100% medical coverage for employees and their dependents.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Kernel Engineer for High-Performance AI Inference
GPU Kernel Engineer for High-Performance AI Inference

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
Paid parental leave
+2
GPU Kernel Engineer - High-Performance ML Acceleration
GPU Kernel Engineer - High-Performance ML Acceleration

Baseten • Seattle (WA)

On-site
USD 180,000 - 360,000
GPU Kernel Engineer for High-Performance ML
GPU Kernel Engineer for High-Performance ML

MakerMaker.AI • San Francisco (CA)

On-site
USD 180,000 - 230,000
Open-source collaboration
Hybrid/On-site flexibility
Competitive compensation
GPU/Kernel Engineer
GPU/Kernel Engineer

Acceler8 Talent • Palo Alto (CA)

On-site
USD 180,000 - 240,000
GPU Kernel Optimization Engineer
GPU Kernel Optimization Engineer

Acceler8 Talent • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Software Engineer – GPU Kernel
Software Engineer – GPU Kernel

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
GPU Kernel Engineer — High-Performance ML at Scale
GPU Kernel Engineer — High-Performance ML at Scale

The Consensus • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation with equity
100% medical, dental, and vision insurance coverage
Flexible PTO policy including a Winter Break
+2
GPU Kernel Performance Engineer — HPC/AI Infrastructure
GPU Kernel Performance Engineer — HPC/AI Infrastructure

Designworks Talent • Bellevue (WA)

Hybrid
USD 140,000 - 190,000
GPU Kernel Engineer – AI Inference & CUDA Optimizations
GPU Kernel Engineer – AI Inference & CUDA Optimizations

FriendliAI Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Flexible working hours
Daily meals / snacks provided
Health insurance
+2
GPU Kernel Engineer for Fast AI Training & Inference
GPU Kernel Engineer for Fast AI Training & Inference

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Equity
Visa sponsorship
Relocation assistance
+1