GPU Performance Architect: 5-10x Speedups on H100

Genmo AI

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Genmo is seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits. You will profile, tune, and implement high-performance CUDA and Triton kernels, dramatically reducing cold start latency and unlocking 5–10x speedups.

You will collaborate with ML engineers to optimize model implementations, debug across the full stack, and push hardware and software boundaries in production environments.

Qualifications

  • Bachelor's or Master's in Computer Science, Electrical Engineering, or related field.
  • 5+ years systems programming experience with 3+ years focused on GPU optimization.
  • Expert proficiency with GPU profiling tools (Nsight Systems, nvprof).
  • Strong CUDA programming skills with production kernel development.
  • Deep understanding of GPU architecture (memory hierarchy, SMs, warps).
  • Track record of achieving significant performance improvements (5-10x).
  • Experience with Python and C++ in production environments.

Responsibilities

  • Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation.
  • Write high-performance CUDA and Triton kernels for critical model operations.
  • Optimize cold start latency from seconds to milliseconds for our serving infrastructure.
  • Tune memory access patterns, kernel fusion, and GPU utilization.
  • Collaborate with ML engineers to optimize model implementations.
  • Debug performance issues across the full stack from application to hardware.
  • Implement custom memory pooling and allocation strategies.
  • Share optimization techniques and build performance culture across teams.

Skills

GPU profiling
CUDA programming
Performance optimization
C++
Python
System programming

Education

Bachelor's or Master's in CS/EE

Tools

Nsight Systems
nvprof
Triton
PTX/SASS debugging

Job description

Genmo is seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits. You will profile, tune, and implement high-performance CUDA and Triton kernels, dramatically reducing cold start latency and unlocking 5–10x speedups.

You will collaborate with ML engineers to optimize model implementations, debug across the full stack, and push hardware and software boundaries in production environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Performance Engineer
GPU Performance Engineer

Genmo AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
GPU Performance Engineer for AI Models
GPU Performance Engineer for AI Models

Advanced Micro Devices, Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
GPU Performance Engineer - CUDA/C++ & Shader Optimization
GPU Performance Engineer - CUDA/C++ & Shader Optimization

Crossing Hurdles • United States

On-site
USD 120,000 - 180,000
Performance Engineer: GPU Kernel & Inference Optimize
Performance Engineer: GPU Kernel & Inference Optimize

WORLD LABS • San Francisco (CA)

On-site
USD 200,000 - 300,000
GPU Performance Engineer & CUDA Kernel Architect
GPU Performance Engineer & CUDA Kernel Architect

Liquid AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Medical/Dental/Vision
401(k) match
+2
GPU Kernel Engineer for High-Performance ML
GPU Kernel Engineer for High-Performance ML

MakerMaker.AI • San Francisco (CA)

On-site
USD 180,000 - 230,000
Open-source collaboration
Hybrid/On-site flexibility
Competitive compensation
Performance Engineer
Performance Engineer

Acceler8 Talent • Mountain View (CA)

On-site
USD 180,000 - 260,000
GPU AI Optimization Engineer for HPC & LLMs
GPU AI Optimization Engineer for HPC & LLMs

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
GPU Kernel Engineer - High-Performance ML Acceleration
GPU Kernel Engineer - High-Performance ML Acceleration

Baseten • Seattle (WA)

On-site
USD 180,000 - 360,000
ML Performance Engineer: Production GPU Optimizer
ML Performance Engineer: Production GPU Optimizer

Goliath Partners Inc. • New York (NY)

On-site
USD 200,000 - 300,000