GPU Kernel Engineer: Build Fast AI Inference at Scale

Baseten

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive compensation
100% medical coverage
Generous PTO policy
Paid parental leave
Company-facilitated 401(k)

Job summary

A leading AI acceleration company in San Francisco is seeking a GPU Kernel Engineer to optimize performance for machine learning models. You will be responsible for designing high-performance GPU kernels and using advanced techniques to boost computation efficiency. Ideal candidates have 1–5 years of CUDA development experience and a strong understanding of GPU architecture. This position offers competitive compensation, including equity, and comprehensive benefits including medical coverage and generous PTO.

Qualifications

  • 1–5 years of experience in CUDA development.
  • Strong understanding of GPU architecture and programming paradigms.
  • Proficient in C++ and GPU performance profiling tools.

Responsibilities

  • Design and implement high-performance GPU kernels for ML operations.
  • Write and optimize code using CUDA and architecture-specific techniques.
  • Identify and resolve performance bottlenecks using profiling tools.

Skills

CUDA development
GPU architecture understanding
C++ proficiency
Performance profiling tools

Tools

CUDA C++ API
Nsight Systems
Nsight Compute

Job description

A leading AI acceleration company in San Francisco is seeking a GPU Kernel Engineer to optimize performance for machine learning models. You will be responsible for designing high-performance GPU kernels and using advanced techniques to boost computation efficiency. Ideal candidates have 1–5 years of CUDA development experience and a strong understanding of GPU architecture. This position offers competitive compensation, including equity, and comprehensive benefits including medical coverage and generous PTO.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU Kernel Engineer for High-Performance AI Inference
GPU Kernel Engineer for High-Performance AI Inference

Baseten • San Francisco (CA)

On-site
USD 180,000 - 360,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
+3
GPU Kernel Engineer for AI Inference & Performance
GPU Kernel Engineer for AI Inference & Performance

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
Senior AI Kernel Engineer — GPU Inference & Kernel Optimization
Senior AI Kernel Engineer — GPU Inference & Kernel Optimization

Modular • United States

Hybrid
USD 198,000 - 286,000
GPU Kernel Engineer for High-Performance AI Inference
GPU Kernel Engineer for High-Performance AI Inference

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Senior GPU Inference Engine Engineer
Senior GPU Inference Engine Engineer

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Flexible working hours
Daily lunch and dinner provided; unlimited snacks and beverages
Health check-up support and top-tier equipment/hardware support
+2
CUDA GPU Kernel Architect for High-Throughput AI
CUDA GPU Kernel Architect for High-Throughput AI

TypeSafe AI • San Francisco (CA)

On-site
USD 180,000 - 280,000
Base salary $180k–$280k plus equity
100% covered health insurance
Daily lunch and dinner
+2
Staff GenAI Kernel & Performance Engineer
Staff GenAI Kernel & Performance Engineer

Databricks • San Francisco (CA)

On-site
USD 190,000 - 233,000
Senior Kernel & Compiler Performance Engineer (GPU/AI)
Senior Kernel & Compiler Performance Engineer (GPU/AI)

RadixArk • Palo Alto (CA)

On-site
USD 210,000 - 290,000
Competitive compensation
Comprehensive benefits
Flexible work arrangements
Software Engineer – GPU Kernel
Software Engineer – GPU Kernel

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
Staff Engineer: GPU Kernels & AI Performance
Staff Engineer: GPU Kernels & AI Performance

Gimlet Labs • San Francisco (CA)

On-site
USD 120,000 - 160,000