GPU Performance Engineer: Accelerate AI Video Pipelines

Heygen

Los Angeles, Palo Alto, San Francisco (CA, CA, CA)

On-site

USD 130,000 - 170,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Dynamic work environment
Growth opportunities
Collaborative culture
Access to latest tools

Job summary

HeyGen is seeking a Software Engineer focused on GPU performance to accelerate AI video applications and related workloads. You will work across model execution, inference infrastructure, and profiling to reduce latency and cost while increasing throughput.

Ideal candidates will have a strong background in GPU hardware, profiling, and Python-based ML frameworks, with experience in delivering production-grade performance improvements at scale.

Qualifications

  • Experience optimizing GPU-based AI workloads or high-performance computing systems.
  • Proficiency in Python and PyTorch or a similar ML framework.
  • Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and CPU-GPU data movement.
  • Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.
  • Ability to turn performance experiments into reliable production changes and communicate tradeoffs clearly.

Responsibilities

  • Use profiling tools to investigate GPU utilization, kernel execution, memory bandwidth, and CPU–GPU data movement.
  • Identify bottlenecks across model execution, preprocessing, and inference serving, then measure the impact of each optimization.
  • Improve performance through batching, scheduling, memory management, and better GPU utilization.
  • Develop or integrate high-performance GPU kernels when existing implementations limit performance.
  • Build benchmarks and automated checks that catch performance regressions across representative video workloads.
  • Collaborate with AI researchers and infrastructure engineers to bring optimizations into production.
  • Measure the effect of changes on latency, throughput, cost, and output quality.

Skills

GPU optimization
Python
PyTorch
Profiling
Latency reduction
Performance tuning

Education

B.S. in CS/EE

Tools

CUDA
Triton
C++

Job description

HeyGen is seeking a Software Engineer focused on GPU performance to accelerate AI video applications and related workloads. You will work across model execution, inference infrastructure, and profiling to reduce latency and cost while increasing throughput.

Ideal candidates will have a strong background in GPU hardware, profiling, and Python-based ML frameworks, with experience in delivering production-grade performance improvements at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Performance Engineer - AI Inference & Acceleration
GPU Performance Engineer - AI Inference & Acceleration

We Love AI Jobs • Los Angeles (CA)

Hybrid
USD 120,000 - 170,000
Software Engineer, GPU Performance
Software Engineer, GPU Performance

Heygen • Los Angeles (CA), Palo Alto (CA), San Francisco (CA)

On-site
USD 130,000 - 170,000
Competitive salary
Dynamic work environment
Growth opportunities
+2
Lead GPU Inference Performance Engineer
Lead GPU Inference Performance Engineer

present of AI • United States

Remote
USD 140,000 - 210,000
GPU/Kernel Engineer
GPU/Kernel Engineer

Acceler8 Talent • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Principal Engineer, Model Performance
Principal Engineer, Model Performance

present of AI • United States

Remote
USD 140,000 - 210,000
GPU Kernel Engineer - High-Performance ML Acceleration
GPU Kernel Engineer - High-Performance ML Acceleration

Baseten • Seattle (WA)

On-site
USD 180,000 - 360,000
GPU Performance Engineer for AI Models
GPU Performance Engineer for AI Models

Advanced Micro Devices, Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Backend Infrastructure Engineer - Scalable ML & Data Systems
Backend Infrastructure Engineer - Scalable ML & Data Systems

Heygen • San Francisco (CA)

On-site
USD 180,000 - 240,000
401k plan
Health benefits
Generous PTO
+2
GPU Kernel Performance Engineer — HPC/AI Infrastructure
GPU Kernel Performance Engineer — HPC/AI Infrastructure

Designworks Talent • Bellevue (WA)

Hybrid
USD 140,000 - 190,000
GPU Performance Engineer
GPU Performance Engineer

Genmo AI • San Francisco (CA)

On-site
USD 180,000 - 240,000