Senior GPU Kernel Engineer — Turbocharge Inference

relace

San Francisco (CA)

On-site

USD 180,000 - 300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Relace is seeking a senior, low-level systems engineer to join our San Francisco team. You will write and tune the code that runs directly on GPU hardware, pushing more work per second and per dollar while shrinking models to cut costs.

You will own performance improvements end to end, with a focus on memory, concurrency, and low-level optimization. We value demonstrable speedups and rigorous measurement, and we don’t require CUDA background—just strong fundamentals and curiosity.

Qualifications

  • Five or more years of low-level performance work where the speed of the system mattered.
  • Strong C or C++ and real comfort at a low level: memory, concurrency, caches.
  • Track record of making something significantly faster and able to explain why.
  • Habit of measuring with profiling and careful testing.

Responsibilities

  • Write and tune the code that runs directly on GPU hardware.
  • Push more work per second and per dollar, shrinking models to cut costs.
  • Identify and fix bottlenecks; measure before and after changes.
  • Own end-to-end performance improvements with a bias for rigor.

Skills

Low-level perf
C/C++
Memory
Concurrency
Profiling
Performance opt

Job description

Relace is seeking a senior, low-level systems engineer to join our San Francisco team. You will write and tune the code that runs directly on GPU hardware, pushing more work per second and per dollar while shrinking models to cut costs.

You will own performance improvements end to end, with a focus on memory, concurrency, and low-level optimization. We value demonstrable speedups and rigorous measurement, and we don’t require CUDA background—just strong fundamentals and curiosity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Kernel Engineer, High-Performance Compiler
Senior GPU Kernel Engineer, High-Performance Compiler

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Equity
GPU Kernel Engineer
GPU Kernel Engineer

relace • San Francisco (CA)

On-site
USD 180,000 - 300,000
Performance Engineer: GPU Kernel & Inference Optimize
Performance Engineer: GPU Kernel & Inference Optimize

WORLD LABS • San Francisco (CA)

On-site
USD 200,000 - 300,000
Real-Time GPU Optimization Engineer - Inference
Real-Time GPU Optimization Engineer - Inference

techire ai • San Francisco (CA)

On-site
USD 230,000 - 300,000
Senior GPU Inference Engineer — TensorRT & Compiler Optimizations
Senior GPU Inference Engineer — TensorRT & Compiler Optimizations

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 170,000 - 260,000
Equity
Senior GPU Kernel Optimizer for LLM Inference
Senior GPU Kernel Optimizer for LLM Inference

NVIDIA • Seattle (WA)

On-site
USD 184,000 - 287,500
Senior Inference Performance Engineer - GPU & CUDA
Senior Inference Performance Engineer - GPU & CUDA

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits
Senior GPU Kernel Engineer for AI Infrastructure
Senior GPU Kernel Engineer for AI Infrastructure

Designworks Talent LLC • Bellevue (KY)

Hybrid
USD 170,000 - 250,000
Hybrid work model
Medical, dental, vision insurance
Senior GPU Inference Engineer — TensorRT & Compiler
Senior GPU Inference Engineer — TensorRT & Compiler

NVIDIA Corporation • United States

Hybrid
USD 152,000 - 288,000
Equity (RSU)
Benefits
Senior GPU Kernel & Performance Engineer
Senior GPU Kernel & Performance Engineer

Designworks Talent LLC • Bellevue (WA)

Hybrid
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+2