Research Scientist: Scalable Multimodal Robotics

Pantograph; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Pantograph is training general models starting from large-scale video and expanding to robotics. We seek research scientists to scale simple methods across massive datasets. You’ll work on pre-training, self-supervised RL, and video modeling, with a focus on scalable, interpretable metrics and rigorous evaluation.

We value contributions from open-source projects and lab experience, and welcome researchers who enjoy translating theory into practical, real-world robotic systems.

Qualifications

• Experience with large-scale pre-training (video, multimodal, image, or language).
• Experience with self-supervised, goal-conditioned, or unsupervised RL.
• Robotics models trained on large-scale data.
• Video generation or sequence modeling over high-dimensional observations (pixels).
• Trained models on large GPU clusters and are comfortable working with Kubernetes.
• Believe simple scalable methods beat complexity; aim for simplest effective solution.
• Strive to define expressive metrics and measure them accurately.
• Value scientific integrity and understand true effects of interventions.
• Nice to have: Experience with JAX; interest in adjacent problems; strong background in measure-theoretic probability, stochastic processes, optimization.

Skills

Large-scale pre-training

Self-supervised RL

Robotics data models

Video sequence modeling

GPU clusters

Kubernetes

Simple methods

Expressive metrics

Tools

JAX

Job description

Pantograph is training general models starting from large-scale video and expanding to robotics. We seek research scientists to scale simple methods across massive datasets. You’ll work on pre-training, self-supervised RL, and video modeling, with a focus on scalable, interpretable metrics and rigorous evaluation.

We value contributions from open-source projects and lab experience, and welcome researchers who enjoy translating theory into practical, real-world robotic systems.