Senior ML Engineer – World Models & Multimodal AI

Socket.dev; Santa Clara (CA); On-site; USD 175,000 - 296,000; Full time

Benefits offered by this job

Competitive compensation

Snacks, lunches, dinners

Career growth opportunities

Job summary

XPENG is seeking Machine Learning Engineers specializing in generative modeling and large‑scale deep learning systems. You will research, implement, and evaluate world models that learn dynamics from large multimodal data, serving as learned simulators for training driving and robotics policies.

Work with diffusion and flow‑matching models, video tokenizers, and transformer‑based backbones. You will collaborate with a world‑class team of experts in computer vision, generative AI, and AI systems,

Qualifications

• MS or PhD level education in Engineering or Computer Science with a focus on Deep Learning or related field.

Responsibilities

• Research and develop predictive world models that forecast scene evolution from multimodal driving and robotics data.
• Develop high‑quality multi‑view future prediction supporting action‑conditioned and unconditional rollouts.
• Extend prediction into a 3D multimodal latent space and enable single model for simulation, evaluation and policy training.

Skills

Deep Learning

Python

Experiment design

Algorithms

PyTorch

Distributed training

Education

MS/PhD in Engineering or CS

Tools

PyTorch

DeepSpeed

Megatron

Job description

XPENG is seeking Machine Learning Engineers specializing in generative modeling and large‑scale deep learning systems. You will research, implement, and evaluate world models that learn dynamics from large multimodal data, serving as learned simulators for training driving and robotics policies.

Work with diffusion and flow‑matching models, video tokenizers, and transformer‑based backbones. You will collaborate with a world‑class team of experts in computer vision, generative AI, and AI systems,