CUDA GPU Kernel Architect for High-Throughput AI

TypeSafe AI

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Base salary $180k–$280k plus equity
100% covered health insurance
Daily lunch and dinner
Visa sponsorships
401K plans

Job summary

TypeSafe AI in San Francisco is seeking a GPU kernel engineer with deep CUDA expertise to accelerate our training and inference workloads. You will write, optimize, and maintain high-performance kernels close to the metal.

Work alongside research and platform engineers to squeeze throughput and reduce latency, with the team operating in-person at our SF office near Embarcadero. This role requires hands-on LLM training experience and a track record of real performance wins.

Qualifications

  • Deep CUDA / GPU kernel expertise.
  • Experience building and optimizing inference / training kernels.
  • Hands-on LLM training experience (not hobbyist).
  • Reason from first principles about performance, memory, and parallelism.

Responsibilities

  • Write, optimize, and maintain high-performance GPU kernels (e.g., in CUDA / CuTe DSL) for training and inference
  • Profile end-to-end performance and eliminate bottlenecks across the stack
  • Partner with research and platform engineers to squeeze maximum throughput and minimum latency out of our hardware

Skills

CUDA / GPU kernel expertise
Inference & training kernels
LLM training experience
Performance optimization

Tools

CuTe DSL
CUDA

Job description

TypeSafe AI in San Francisco is seeking a GPU kernel engineer with deep CUDA expertise to accelerate our training and inference workloads. You will write, optimize, and maintain high-performance kernels close to the metal.

Work alongside research and platform engineers to squeeze throughput and reduce latency, with the team operating in-person at our SF office near Embarcadero. This role requires hands-on LLM training experience and a track record of real performance wins.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU Kernel Engineer for High-Performance AI Inference
GPU Kernel Engineer for High-Performance AI Inference

Baseten • San Francisco (CA)

On-site
USD 180,000 - 360,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
+3
GPU Kernel Engineer for AI Inference & Performance
GPU Kernel Engineer for AI Inference & Performance

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
GPU Kernel Engineer: Build Fast AI Inference at Scale
GPU Kernel Engineer: Build Fast AI Inference at Scale

Baseten • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation
100% medical coverage
Generous PTO policy
+2
Founding GPU Kernel Engineer — Hand‑Tuned ML Kernels
Founding GPU Kernel Engineer — Hand‑Tuned ML Kernels

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Equity
Comprehensive benefits package
Staff Engineer: GPU Kernels & AI Performance
Staff Engineer: GPU Kernels & AI Performance

Gimlet Labs • San Francisco (CA)

On-site
USD 120,000 - 160,000
GPU Kernel Engineer — Fast ML Training
GPU Kernel Engineer — Fast ML Training

MakerMaker.AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
CUDA Kernel Engineer for Massive GPU Compute
CUDA Kernel Engineer for Massive GPU Compute

Pantera Capital • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Comprehensive medical, vision, and dental coverage
401(k) retirement plan
Equity options
+2
Pioneering GPU Kernel Engineer for ML Performance
Pioneering GPU Kernel Engineer for ML Performance

SF Tensor • San Francisco (CA)

On-site
USD 285,000 - 315,000
GPU Kernel Engineer
GPU Kernel Engineer

TypeSafe AI • San Francisco (CA)

On-site
USD 180,000 - 280,000
Base salary $180k–$280k plus equity
100% covered health insurance
Daily lunch and dinner
+2
CUDA Deep Learning Systems Engineer – High-Performance Kernels
CUDA Deep Learning Systems Engineer – High-Performance Kernels

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 124,000 - 196,000