Senior ML Performance Engineer – Scale Training & Systems

ContentBuffer

Santa Clara (CA)

On-site

USD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

XPENG is seeking a Senior Staff Machine Learning Performance Engineer to own the speed of end-to-end autonomous model training across thousands of accelerators. You will optimize GPU training and inference workloads in production, diagnose bottlenecks, and push fixes to become default implementations.

You will collaborate with modeling, infrastructure, simulation, data-mining and robotics teams to drive scalable performance improvements and robust, auditable systems.

Qualifications

  • 8+ years of industry experience in performance engineering.
  • Hands-on experience optimizing GPU training or inference workloads in production at multi-node scale.
  • Proven track record diagnosing performance problems in production workloads and delivering fixes.

Responsibilities

  • Train performance at scale: optimize step time, scaling, and long-run stability across accelerators.
  • Lead cross-team technical initiatives with modeling, infrastructure, simulation, data-mining and robotics teams.
  • Create reusable components that become defaults across models and workloads.
  • Extend observability tooling and metrics with low instrumentation overhead for production jobs fleet-wide.
  • Build agentic automation: reproduce jobs on demand and verify numerical parity to catch regressions.

Skills

Advanced performance engineering
GPU training optimization
Production systems debugging

Education

Master's or PhD in CS, CE or EE

Job description

XPENG is seeking a Senior Staff Machine Learning Performance Engineer to own the speed of end-to-end autonomous model training across thousands of accelerators. You will optimize GPU training and inference workloads in production, diagnose bottlenecks, and push fixes to become default implementations.

You will collaborate with modeling, infrastructure, simulation, data-mining and robotics teams to drive scalable performance improvements and robust, auditable systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Performance Engineer - Scale GPU Training
Senior ML Performance Engineer - Scale GPU Training

Xpeng Inc. • Santa Clara (CA)

On-site
USD 244,000 - 413,000
Competitive compensation package
Snacks, lunches, dinners, and funกิจ
Senior ML Performance Engineer – Scaled Training
Senior ML Performance Engineer – Scaled Training

Xpengmotors • Santa Clara (CA)

On-site
USD 244,000 - 413,000
Competitive compensation package
Snacks, lunches, and dinners
S Senior Staff Machine Learning Performance Engineer Santa Clara, CA, US Principal Python C++ PyTorch
S Senior Staff Machine Learning Performance Engineer Santa Clara, CA, US Principal Python C++ PyTorch

ContentBuffer • Santa Clara (CA)

On-site
USD 150,000 - 210,000
Senior Staff Machine Learning Performance Engineer
Senior Staff Machine Learning Performance Engineer

Xpengmotors • Santa Clara (CA)

On-site
USD 244,000 - 413,000
Competitive compensation package
Snacks, lunches, and dinners
Senior Staff Machine Learning Performance Engineer
Senior Staff Machine Learning Performance Engineer

Xpeng Inc. • Santa Clara (CA)

On-site
USD 244,000 - 413,000
Competitive compensation package
Snacks, lunches, dinners, and funกิจ
AI Performance Engineer: Scale ML Throughput & Training
AI Performance Engineer: Scale ML Throughput & Training

Applied Intuition • Sunnyvale (CA)

On-site
USD 180,000 - 260,000
ML Performance Engineer — Optimize GPU Training at Scale
ML Performance Engineer — Optimize GPU Training at Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior AI Training Performance Architect — Optimize at Scale
Senior AI Training Performance Architect — Optimize at Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 210,000 - 340,000
Equity
Benefits
Lead ML Engineer, Robotics Autonomy & Scalable Training
Lead ML Engineer, Robotics Autonomy & Scalable Training

Serve Robotics Inc • United States

Remote
USD 180,000 - 250,000
AI Performance Engineer: Scale ML Throughput & Efficiency
AI Performance Engineer: Scale ML Throughput & Efficiency

Decisive Point • Sunnyvale (CA)

Hybrid
USD 180,000 - 240,000