Deep Learning Engineer - World Models

Humanoid; Greater London; On-site; GBP 70,000 - 120,000; Full time

Benefits offered by this job

Stock options

30+ paid days off

Private healthcare

Pension scheme

Free daily breakfast and in-office食

In-office snacks

Direct access to leadership

Job summary

Humanoid is seeking a Research Engineer for the World Models team to build action-conditioned multimodal models predicting how our humanoid robots interact with real environments. You will design architectures, run large training jobs, and validate models against fleet data from industrial deployments.

You will work with diffusion models, transformers, and learned simulators to enable safe, scalable policy development and sim-to-real transfer in real-world robotics applications.

Qualifications

• Experience training large multimodal models (video, world, or multimodal).
• Deep hands-on experience with diffusion models, autoregressive transformers, or video prediction.
• Experience with large-scale distributed training and data pipelines.
• Strong Python + PyTorch/JAX; profile kernels and optimize data loaders.
• Empirical rigor in evaluating models and documenting experiments clearly.
• Interest in grounding generative models in physical reality, not pixels alone.

Responsibilities

• Design and train multimodal world models using diffusion-based and transformer architectures.
• Build action-conditioned video prediction and dynamics models with long-horizon physical consistency.
• Develop learned-simulator evaluation to predict real-world success and safety outcomes.
• Generate synthetic rollouts and counterfactual data to enhance policy training.
• Establish fidelity metrics and calibration protocols for world models.
• Build data pipelines turning fleet telemetry and video into training corpora.
• Run scaling and ablation studies on architecture, data mix, and context length.
• Collaborate with pretraining, RL, and manipulation teams to integrate world models into policy training.

Skills

Generative modeling

Python

Distributed training

Experimentation

Tools

PyTorch

JAX

Transformers

Job description

Here at Humanoid, we believe in a future where robots amplify human potential. That’s why we’ve set out on a mission to build the world’s most capable, commercially-scalable, and safe humanoid robots. We’re bringing that mission to life with HMND‑01 - our rapidly developed humanoid platform being deployed in real industrial environments - and we’re growing the team to take it even further.

Our Mission

At Humanoid we strive to create the world's leading, commercially scalable, safe, and advanced humanoid robots that seamlessly integrate into daily life and amplify human capacity.

About The Role

As a Research Engineer on the World Models team, you will build action‑conditioned generative models that predict how the world evolves around our robots — future video, proprioception, contacts, and outcomes — from past observations and actions. World models serve four purposes in our stack: a pretrained, physics‑aware prior for our VLA policies; an engine for rare data collection, cross‑platform transfer, and sim‑to‑real transfer; a testbed for policy evaluation and testing before hardware; and a future‑prediction rollout engine that surfaces what our policies intend to do, for safety and planning. This is a hands‑on individual contributor role: you will design architectures, run large training jobs, and validate your models against real fleet data from industrial deployments.

What You’ll Do

• Design and train multimodal world models — video, state, action, and language — using diffusion‑based and transformer architectures.
• Build action‑conditioned video prediction and dynamics models that stay physically consistent over long horizons, including contact‑rich manipulation, and serve as pretrained priors for VLA policies.
• Develop learned‑simulator evaluation: score candidate policies offline, predict real‑world success rates before deployment, and roll out policy futures to expose intended behaviour for safety review and planning.
• Generate synthetic rollouts and counterfactual experience — including rare events, cross‑platform transfer, and sim‑to‑real transfer — to augment policy training, and measure their effect on downstream task performance.
• Establish fidelity metrics and calibration protocols that quantify where the world model can be trusted and where it diverges from reality.
• Build data pipelines that turn fleet telemetry, teleoperation logs, and internet‑scale video into training corpora for world models.
• Run scaling and ablation studies on architecture, data mixture, and context length; communicate findings crisply.
• Collaborate with pretraining, RL, and manipulation teams to integrate world models into policy training and evaluation loops.

What We’re Looking For

• A track record of training large generative models — video, world, or multimodal — with shipped models or published artifacts to show for it.
• Deep hands‑on experience with modern generative architectures: diffusion models, autoregressive transformers, latent‑variable models, or video prediction.
• Experience with large‑scale distributed training: streaming datasets, checkpointing and state management, debugging numerics and training instabilities.
• Strong Python + PyTorch/JAX; you can profile kernels, optimize data loaders, and write maintainable research code.
• Empirical rigor: you design careful evaluations, run honest baselines, and document experiments clearly.
• Excitement about grounding generative models in physical reality rather than pixels alone.

Nice to have

• Experience with world models for robotics or autonomous driving (e.g., action‑conditioned video models, learned simulators, model‑based RL).
• Familiarity with robotics simulators (Isaac Sim, MuJoCo) and sim‑to‑real considerations.
• Experience using world models for policy evaluation or synthetic data generation at scale.
• Publications at top‑tier deep learning conferences (NeurIPS, ICML, ICLR, CoRL, CVPR) or equivalent open‑source contributions.
• Experience optimizing generative models for fast inference.

What We Offer

• Competitive equity: stock options with meaningful upside as we scale.
• 30+ paid days off, including 23 days of annual leave, all UK bank holidays, and additional company closure days (including Christmas–New Year shutdown).
• Private healthcare, including virtual and in‑person care.
• Pension scheme with 8% total contribution (5% employee, 3% employer) on full earnings.
• Free daily breakfast, catered lunch, and snacks in‑office.
• Work at the frontier - collaborate daily with world‑class engineers, researchers, and product experts building the next generation of AI and humanoid robotics.
• Real ownership - direct access to founding leadership, meaningful input on product direction, and the ability to drive key initiatives from day one.