Enable job alerts via email!

Research Engineer, World Models

Halodi Robotics

Palo Alto (CA)

On-site

USD 130,000 - 250,000

Full time

3 days ago
Be an early applicant

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

A leading robotics company is seeking a Research Engineer in World Models to develop multi-modal generative models for predicting sensor readings. This role involves full-stack engineering, from data engineering to model design, aiming to enhance robot performance and autonomy. Ideal candidates will have significant experience with Python, deep learning frameworks, and a strong work ethic to tackle complex challenges.

Qualifications

  • 4+ years of experience with Python and deep learning frameworks like TensorFlow and PyTorch.
  • Experience in training deep generative models on video.
  • Ability to iterate rapidly and scale up projects.

Responsibilities

  • Build multi-modal generative models predictive of NEO's sensor readings.
  • Implement data loaders for large multi-modal datasets.
  • Translate improvements in world models to robot autonomy.

Skills

Python
Deep Learning Frameworks
Data Engineering
Distributed Systems

Job description

Target start date: immediately. Relocation provided.

Since its founding in 2015, 1X has been at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids.At 1X, you’ll own critical projects, tackle unsolved research problems, deliver great products to customers, and be rewarded based on merit and achievement.

We are looking for a Research Engineer in World Models. In this role, you will build multi-modal generative models (video, audio, text, actions) that predict all of NEO’s future sensor readings and actions from its past observations and actions. Such foundation models enable general understanding of unstructured environments.

Please only submit your application for one job posting at a time on the AI team. We will consider your application for all roles.

Responsibilities

  • Full-stack engineering, from data engineering to model architecture design to shipping polished products

  • Translate improvements in world models to improvements in robot autonomy.

  • Implement high-throughput data loaders for large multi-modal datasets.

  • Implement tokenizers and transformers to fit web-scale robot data.

  • Predict how real-world robot performance scales with pre-training metrics (e.g. log loss).


  • Getting general-purpose robots to work in the home is just about the hardest problem one can work on. We are looking for people with the courage to tackle unsolved technical challenges with an intense work ethic.

  • 4+ years of experience of Python and Deep Learning Frameworks (TensorFlow, PyTorch, JAX, Keras).

  • Experience training a variety of deep generative models on video.

  • Ability to rapidly iterate on ideas and scale up promising ones to increasing amounts of compute and data.

  • In your cover letter, please tell us about one idea in world modeling that should work but doesn’t work quite yet, and why you think that’s the case.

Nice to have

  • Strong background in distributed systems and parallel computing.

  • Experience in large-scale model training (>70B parameters)

  • Experience with the 1X World Modeling Challenge (Compression, Sampling, Evaluation).

  • Experience writing testing infrastructure for data loaders and robotics datasets.

Sample Projects

We encourage you to apply even if you do not meet every single qualification. If you think you can do an exceptional job at one of the “sample projects” listed below, please let us know in your cover letter.

  • Converting World Models into a policy via visual MPC, and making sampling fast enough to do dynamic motions.

  • Developing evaluation metrics for policies simulated inside world models (e.g. task success prediction from a generated video).

  • Using the World Model for tasks beyond evaluation and training.

Location Policy:

We believe the best work is done when collaborating and therefore require in-person presence in our office locations.

Compensation

At 1X your work and results will be rewarded with a total rewards package consisting of a base salary, stock options and benefits. Base salary range is $130,000 to $250,000. Your actual salary will be based on your knowledge, skills and experience.


Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs

Research Engineer

WorksHub

Remote

USD 200,000 - 300,000

Today
Be an early applicant

Research Engineer - Palo Alto

Mistral AI

Palo Alto

On-site

USD 120,000 - 160,000

2 days ago
Be an early applicant

Research Engineer, World Models

1X

Palo Alto

On-site

USD 130,000 - 250,000

16 days ago

[Hiring] Research Engineer @Helm AI

Helm AI

Remote

USD 150,000 - 250,000

3 days ago
Be an early applicant

Research Engineer - Training Efficiency

The Rundown AI, Inc.

Palo Alto

On-site

USD 120,000 - 180,000

6 days ago
Be an early applicant

Research Engineer - Foundation Models

The Rundown AI, Inc.

Palo Alto

On-site

USD 180,000 - 250,000

6 days ago
Be an early applicant

Research Engineer - Multimodal Language Models

The Rundown AI, Inc.

Palo Alto

On-site

USD 200,000 - 300,000

6 days ago
Be an early applicant

Research Engineer - Applied Research

The Rundown AI, Inc.

Palo Alto

On-site

USD 175,000 - 250,000

6 days ago
Be an early applicant

Lead Machine Learning Engineer/Scientist, Algorithms and Research

Upwork

Remote

USD 175,000 - 278,000

2 days ago
Be an early applicant