Staff LLM Quantization & Deployment Engineer

XPENG

Santa Clara (CA)

On-site

USD 215,000 - 364,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive compensation package
Infrastructures and computational资源

Job summary

XPENG in Santa Clara, CA, is seeking a Staff Machine Learning Engineer to advance LLM quantization and on-vehicle deployment. You will develop PTQ, QAT, mixed-precision inference, and robust production pipelines.

The role requires a Master in CS/EE, 3–5 years of experience, strong PyTorch and Python skills, and the ability to collaborate across research, systems, and product teams. We offer competitive compensation and ample resources.

Qualifications

  • Master in CS/CE/EE with 3–5 years industry experience.
  • Strong understanding of Transformer architectures and LLM inference.
  • Hands-on quantizing or deploying deep learning models in production.
  • Proficiency with PyTorch and at least one inference or compilation stack.
  • Strong Python programming and software engineering skills.

Responsibilities

  • Develop VLA inference models and productionize PTQ/QAT and mixed-precision methods.
  • Build production-grade Python code with testing, observability, and failover handling.
  • Create export, calibration, benchmarking, validation, and deployment pipelines.
  • Collaborate with VLA research, in-vehicle software, and training infra teams.
  • Analyze performance, latency, and numerical accuracy across systems.

Skills

Transformer models
LLM inference
Python programming
Software engineering
Cross-functional collaboration
Problem solving

Education

Master in CS/CE/EE

Tools

PyTorch

Job description

XPENG in Santa Clara, CA, is seeking a Staff Machine Learning Engineer to advance LLM quantization and on-vehicle deployment. You will develop PTQ, QAT, mixed-precision inference, and robust production pipelines.

The role requires a Master in CS/EE, 3–5 years of experience, strong PyTorch and Python skills, and the ability to collaborate across research, systems, and product teams. We offer competitive compensation and ample resources.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior ML Engineer: LLM Quantization & In-Vehicle Deployment
Senior ML Engineer: LLM Quantization & In-Vehicle Deployment

XPENG • Santa Clara (CA)

On-site
USD 175,000 - 296,000
Staff Machine Learning Engineer - LLM Quantization & Deployment
Staff Machine Learning Engineer - LLM Quantization & Deployment

XPENG • Santa Clara (CA)

On-site
USD 215,000 - 364,000
Competitive compensation package
Infrastructures and computational资源
Staff ML Engineer: Edge AI Quantization Lead
Staff ML Engineer: Edge AI Quantization Lead

Socket.dev • Santa Clara (CA)

On-site
USD 161,000 - 241,000
Edge ML Quantization Architect - Staff Engineer
Edge ML Quantization Architect - Staff Engineer

Qualcomm • Santa Clara (CA)

On-site
USD 161,000 - 241,000
Senior Software Engineer - Quantized Inference & ML Precision
Senior Software Engineer - Quantized Inference & ML Precision

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Quantized Inference Engineer - Accelerate LLMs
Senior Quantized Inference Engineer - Accelerate LLMs

NVIDIA AI • Redmond (WA)

On-site
USD 184,000 - 287,500
Equity
Benefits
Staff ML Engineer: LLM Fine-Tuning for RTL/Verilog
Staff ML Engineer: LLM Fine-Tuning for RTL/Verilog

Highbrow Technology Inc • San Jose (CA)

On-site
USD 150,000 - 200,000
Staff Machine Learning Engineer, LLM Fine‑Tuning (Verilog/RTL Applications)
Staff Machine Learning Engineer, LLM Fine‑Tuning (Verilog/RTL Applications)

Highbrow Technology Inc • San Jose (CA)

On-site
USD 150,000 - 200,000
Staff AI Engineer - LLMs, Product Innovation
Staff AI Engineer - LLMs, Product Innovation

Protingent • Hillsborough (CA)

On-site
USD 247,000 - 297,000
Machine Learning Engineer, LLM Fine-Tuning
Machine Learning Engineer, LLM Fine-Tuning

First Soft Solutions LLC • San Jose (CA)

On-site
USD 150,000 - 180,000