GPU Performance Engineer

Genmo AI

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Genmo is seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits. You will profile, tune, and implement high-performance CUDA and Triton kernels, dramatically reducing cold start latency and unlocking 5–10x speedups.

You will collaborate with ML engineers to optimize model implementations, debug across the full stack, and push hardware and software boundaries in production environments.

Qualifications

  • Bachelor's or Master's in Computer Science, Electrical Engineering, or related field.
  • 5+ years systems programming experience with 3+ years focused on GPU optimization.
  • Expert proficiency with GPU profiling tools (Nsight Systems, nvprof).
  • Strong CUDA programming skills with production kernel development.
  • Deep understanding of GPU architecture (memory hierarchy, SMs, warps).
  • Track record of achieving significant performance improvements (5-10x).
  • Experience with Python and C++ in production environments.

Responsibilities

  • Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation.
  • Write high-performance CUDA and Triton kernels for critical model operations.
  • Optimize cold start latency from seconds to milliseconds for our serving infrastructure.
  • Tune memory access patterns, kernel fusion, and GPU utilization.
  • Collaborate with ML engineers to optimize model implementations.
  • Debug performance issues across the full stack from application to hardware.
  • Implement custom memory pooling and allocation strategies.
  • Share optimization techniques and build performance culture across teams.

Skills

GPU profiling
CUDA programming
Performance optimization
C++
Python
System programming

Education

Bachelor's or Master's in CS/EE

Tools

Nsight Systems
nvprof
Triton
PTX/SASS debugging

Job description

We are Genmo, a research lab developing the world’s most sophisticated video world models to understand, simulate, and interact with the physical world. Our mission is to unlock the right brain of AGI. Join us in advancing physical intelligence and enabling robots to learn and act in a changing world.

We’re seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits.

The Role

You’ll be our performance optimization expert, using advanced profiling tools to identify bottlenecks and implementing solutions that achieve 5-10x speedups. From writing custom CUDA kernels to eliminating cold start latency, you’ll ensure our infrastructure delivers world-class performance. This role is perfect for someone who gets excited about microsecond optimizations and pushing hardware to its theoretical limits.

Key Responsibilities
  • Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation
  • Write high-performance CUDA and Triton kernels for critical model operations
  • Optimize cold start latency from seconds to milliseconds for our serving infrastructure
  • Tune memory access patterns, kernel fusion, and GPU utilization
  • Collaborate with ML engineers to optimize model implementations
  • Debug performance issues across the full stack from application to hardware
  • Implement custom memory pooling and allocation strategies
  • Share optimization techniques and build performance culture across teams
Qualifications
  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field
  • 5+ years systems programming experience with 3+ years focused on GPU optimization
  • Expert proficiency with GPU profiling tools (Nsight Systems, nvprof)
  • Strong CUDA programming skills with production kernel development
  • Deep understanding of GPU architecture (memory hierarchy, SMs, warps)
  • Track record of achieving significant performance improvements (5-10x)
  • Experience with Python and C++ in production environments
We Value
  • Experience with Triton kernel development
  • Knowledge of CUTLASS or similar high-performance libraries
  • Background in ML-specific optimizations (attention, transformers)
  • RDMA/InfiniBand optimization experience
  • Contributions to GPU libraries or frameworks
  • Low-level debugging skills (PTX/SASS reading)

Genmo is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Genmo, Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Performance Architect: 5-10x Speedups on H100
GPU Performance Architect: 5-10x Speedups on H100

Genmo AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
GPU Performance Engineer | Experienced Hire
GPU Performance Engineer | Experienced Hire

SIG Susquehanna • Pennsylvania

On-site
USD 120,000 - 150,000
GPU Performance Engineer | Experienced Hire
GPU Performance Engineer | Experienced Hire

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 100,000 - 130,000
Software Engineer – GPU Kernel
Software Engineer – GPU Kernel

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
Performance Engineer
Performance Engineer

Acceler8 Talent • Mountain View (CA)

On-site
USD 180,000 - 260,000
Software Engineer, GPU Performance
Software Engineer, GPU Performance

Heygen • Los Angeles (CA), Palo Alto (CA), San Francisco (CA)

On-site
USD 130,000 - 170,000
Competitive salary
Dynamic work environment
Growth opportunities
+2
GPU Optimization Engineer
GPU Optimization Engineer

techire ai • San Francisco (CA)

On-site
USD 230,000 - 300,000
Performance Engineer
Performance Engineer

Advanced Micro Devices, Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Performance Architect - Heterogeneous Workload Optimization
Senior Performance Architect - Heterogeneous Workload Optimization

NVIDIA Corporation • Westford (MA)

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits package
Senior Performance Architect - Heterogeneous Workload Optimization
Senior Performance Architect - Heterogeneous Workload Optimization

NVIDIA Corporation • Durham (NC)

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits package