GPU Performance Engineer: Scale AI Inference

Anthropic

San Francisco (CA)

On-site

USD 315,000 - 560,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive salary
Equity opportunities
Flexible working hours
Generous vacation and parental leave

Job summary

A leading AI research company in San Francisco is seeking a mid-senior GPU Performance Engineer. In this role, you'll architect systems that enhance GPU performance for groundbreaking AI models. Responsibilities include developing optimizations, collaborating with teams, and troubleshooting performance issues. The position offers a competitive salary range of $315,000—$560,000, equity opportunities, and a supportive work environment that values communication and collaboration.

Qualifications

  • Deep experience with GPU programming and optimization at scale.
  • Able to navigate complex systems from hardware to high-level frameworks.
  • Passionate about delivering measurable performance breakthroughs.

Responsibilities

  • Architect and implement systems for GPU performance in AI.
  • Develop and optimize end-to-end training pipelines.
  • Collaborate with researchers for impact-driven solutions.

Skills

GPU programming and optimization at scale
Collaborative problem-solving
Navigating complex systems
Impact-driven mindset

Education

Bachelor's degree in a related field or equivalent experience

Tools

CUDA
PyTorch/JAX internals
NCCL
Nsight

Job description

A leading AI research company in San Francisco is seeking a mid-senior GPU Performance Engineer. In this role, you'll architect systems that enhance GPU performance for groundbreaking AI models. Responsibilities include developing optimizations, collaborating with teams, and troubleshooting performance issues. The position offers a competitive salary range of $315,000—$560,000, equity opportunities, and a supportive work environment that values communication and collaboration.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Inference Performance Engineer - GPU & CUDA
Senior Inference Performance Engineer - GPU & CUDA

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Senior AI Infrastructure Performance Engineer
Senior AI Infrastructure Performance Engineer

Crusoe • San Francisco (CA)

On-site
USD 172,000 - 210,000
Senior Inference Performance Engineer — GPU & CUDA
Senior Inference Performance Engineer — GPU & CUDA

Inference • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Competitive compensation
Equity in a high-growth startup
Comprehensive benefits
Senior AI Inference Performance Architect
Senior AI Inference Performance Architect

NVIDIA • California (MO)

On-site
USD 152,000 - 242,000
GPU Kernel Engineer for AI Inference & Performance
GPU Kernel Engineer for AI Inference & Performance

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 150,000
Flexible working hours
Daily lunch and dinner
Health check-up support
+3
Lead GPU AI Inference Performance Engineer
Lead GPU AI Inference Performance Engineer

AMD • San Jose (CA)

On-site
USD 150,000 - 200,000
Remote GPU Performance Engineer: Scale Training & Inference
Remote GPU Performance Engineer: Scale Training & Inference

Reka • United States

Remote
USD 120,000 - 150,000
Five weeks of paid leave
Comprehensive healthcare benefits
Visa support for H1B and OPT transfers
Senior AI Inference Performance Engineer (Remote)
Senior AI Inference Performance Engineer (Remote)

DigitalOcean • San Francisco (CA)

Remote
USD 167,000 - 209,000
Senior GPU Inference Engine Engineer
Senior GPU Inference Engine Engineer

FriendliAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Flexible working hours
Daily lunch and dinner provided; unlimited snacks and beverages
Health check-up support and top-tier equipment/hardware support
+2
GPU Kernel Engineer: Build Fast AI Inference at Scale
GPU Kernel Engineer: Build Fast AI Inference at Scale

Baseten • San Francisco (CA)

On-site
USD 120,000 - 160,000
Competitive compensation
100% medical coverage
Generous PTO policy
+2