Research Scientist, World Models

Google DeepMind; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

An AI research organization in the City Of London seeks a Research Scientist to build generative world models. The ideal candidate has a PhD in computer science or machine learning and experience with large-scale transformer models. Responsibilities include implementing infrastructure for generative models and conducting related research. Competitive salary offered.

Qualifications

• Experience with large-scale data pipelines.
• Track record of releases, publications, or open source related to video generation.
• Expertise optimizing efficiency of distributed training systems.

Responsibilities

• Implement core infrastructure to build generative models.
• Conduct research to solve problems for training world simulators.
• Develop metrics and scaling laws for physical intelligence.

Skills

Experience with large-scale transformer models

Strong systems and engineering skills in JAX or PyTorch

Education

PhD in computer science or machine learning

Tools

JAX

PyTorch

Job description

Join an ambitious team building generative world models. We believe World Models will power numerous domains, such as visual reasoning, simulation, planning for embodied agents, and real-time interactive entertainment. The team will contribute directly to building the next generation of generative world models, working directly with the Genie team and closely with others such as Robotics.

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

Implement core infrastructure and conduct research to build generative models of the physical world. Solve essential problems to train world simulators at massive scale, develop metrics and scaling laws for physical intelligence, curate and annotate training data, enable real-time interactive generation, and explore new possibilities for impact with the next generation of models. Embrace the bitter lesson and seek simple methods that survive the test of scale, with emphasis on strong systems and infrastructure.

Areas of focus:

• Infrastructure for large-scale video data pipelines and annotation.
• Inference optimization and distillation for real-time generation.
• Scaling law science for video pretraining.
• Next generation forms of interactivity.
• Methods for long term memory in world models.
• Model research that unlocks additional scaling and improved capabilities.

About You

In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:

• Experience with large-scale transformer models and/or large-scale data pipelines.
• PhD in computer science or machine learning, or equivalent industry experience.
• Track record of releases, publications, and/or open source projects relating to video generation, world models, multimodal language models, or transformer architectures.
• Strong systems and engineering skills in deep learning frameworks like JAX or PyTorch.

In addition, the following would be an advantage:

• Experience building training codebases for large-scale video or multimodal transformers.
• Expertise optimizing efficiency of distributed training systems and/or inference systems.
• Experience with distillation of diffusion models.

Competitive salary applies.

Google DeepMind is committed to equal opportunity employment regardless of race, religion or belief, ethnic or national origin, disability, age, citizenship, marital status, domestic or civil partnership status, sexual orientation, gender identity or any other basis as protected by applicable law. A voluntary self-identification question enables us to monitor and evaluate the effectiveness of our equal opportunities policy within our recruitment process. Your information is used in an aggregated form for these limited purposes and will not form part of your application.