Frontier AI Kernel & Performance Engineer

Zyphra Technologies Inc.

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision, and FSA plans
401(k) plan
Relocation and immigration support
In-office snacks and meals provided
Unlimited PTO and company holidays
In-person team in San Francisco

Job summary

Zyphra Technologies Inc. in San Francisco seeks a Research Engineer - AI Performance & Kernel Optimization to push throughput and reduce latency for large-scale language model training and inference.

You will design and implement optimized kernels across CUDA, HIP, Triton, and other GPU DSLs, collaborating with pretraining and inference teams to realize real-world model gains and scalable performance improvements.

Qualifications

  • Strong engineering aptitude for building reliable, high-performance systems.
  • Excellent low-level performance intuition and ability to reason about hardware-software interactions.
  • Excellent communication and collaboration skills, with the ability to work effectively across research and engineering teams.
  • Enjoy diving deep into the weeds and hunting down the last 10-20% of performance.

Responsibilities

  • Kernel development and optimization for large-scale ML workloads, using CUDA, HIP, Triton or other GPU DSLs.
  • Performance tuning for training and inference stacks across GPUs and accelerators.
  • Profiling and eliminating bottlenecks in memory movement, scheduling, and compute utilization.
  • Optimizing distributed training and inference systems for large MoE models and model parallelism.
  • Portability and optimization across non-NVIDIA hardware, including AMD MI300x/MI355x.
  • Collaborate with research and infrastructure teams to translate improvements into real-world gains.

Skills

Kernel development
Performance tuning
Distributed training
Profiling
Memory hierarchy
CUDA
HIP
Triton
Communication overlap

Education

Physics / Mathematics / CS background

Tools

CUDA
HIP
Triton
Profiling tools

Job description

Zyphra Technologies Inc. in San Francisco seeks a Research Engineer - AI Performance & Kernel Optimization to push throughput and reduce latency for large-scale language model training and inference.

You will design and implement optimized kernels across CUDA, HIP, Triton, and other GPU DSLs, collaborating with pretraining and inference teams to realize real-world model gains and scalable performance improvements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Performance & Kernel Optimization Engineer
AI Performance & Kernel Optimization Engineer

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Medical benefits
Dental & Vision
FSA plans
+5
Research Engineer - AI Performance & Kernel Optimization
Research Engineer - AI Performance & Kernel Optimization

Zyphra • San Francisco (CA)

On-site
USD 120,000 - 160,000
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k) plan
Relocation and immigration support
+3
Research Engineer – AI Performance & Kernel Optimization
Research Engineer – AI Performance & Kernel Optimization

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
Medical, dental, vision, and FSA plans
401(k) plan
Relocation and immigration support
+3
Research Engineer - AI Performance & Kernel Optimization
Research Engineer - AI Performance & Kernel Optimization

Bison • San Francisco (CA)

On-site
USD 180,000 - 260,000
Medical benefits
Dental & Vision
FSA plans
+5
Senior AI GPU Kernel Engineer - High-Performance LLM Training (Hybrid)
Senior AI GPU Kernel Engineer - High-Performance LLM Training (Hybrid)

Datadog, Inc. • Paris (KY)

Hybrid
USD 150,000 - 230,000
AI Performance & Kernel Engineer for Frontier-Scale ML
AI Performance & Kernel Engineer for Frontier-Scale ML

Zyphra • San Francisco (CA)

On-site
USD 120,000 - 160,000
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k) plan
Relocation and immigration support
+3
Performance Engineer: GPU Kernel & Inference Optimize
Performance Engineer: GPU Kernel & Inference Optimize

WORLD LABS • San Francisco (CA)

On-site
USD 200,000 - 300,000
GPU Kernel Engineer for Fast AI Training & Inference
GPU Kernel Engineer for Fast AI Training & Inference

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Equity
Visa sponsorship
Relocation assistance
+1
GPU Kernel Engineer — Accelerate AI Training & Inference
GPU Kernel Engineer — Accelerate AI Training & Inference

River AI Inc. • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Health insurance
Dental insurance
Vision insurance
+3
Pretraining Engineer — Scalable Language Models on GPUs
Pretraining Engineer — Scalable Language Models on GPUs

Zyphra Technologies Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Comprehensive medical, dental, vision
Relocation support
In-office snacks and meals
+2