Vision-Language Robotics Research Scientist — Equity & Data

XDOF; San Mateo; On-site; PHP 9,452,000 - 11,972,000; Full time

Benefits offered by this job

Competitive compensation and equity

Comprehensive health and wellness

Flexible work arrangements

Collaborative environment

Shape future of robotics and AI

Job summary

XDOF is seeking a Research Engineer/Scientist to lead efforts at the intersection of vision-language models and robot learning. You will turn raw egocentric and teleoperation video into high-signal training data for VLA models and contribute to model development.

You will explore metadata and annotations to unlock capabilities across cross-embodiment transfer, curriculum generation, and world models, shaping data-driven robotics research into production systems.

Qualifications

• MS or PhD in Computer Science, Robotics, Machine Learning, or related field from a top-tier program.
• 3–7 years of research or applied research in vision-language models, video understanding, robot learning, or generative modeling.
• Deep fluency in PyTorch and working knowledge of large-scale training infrastructure (distributed training, mixed precision, large batch workflows).
• Published work or demonstrable impact in VLMs/VLAs, video representation learning, imitation learning, or related areas.
• Strong engineering fundamentals — able to design clean, scalable systems.

Responsibilities

• Design and implement vision-language pipelines for egocentric and teleoperation video: structured captioning, temporal grounding, action-conditioned scene understanding, and semantic annotation at scale.
• Develop and evaluate representations bridging visual perception, language, and low-level robot action across VLAs, video prediction, and world models.
• Build and improve data curation systems that assess quality, diversity, and coverage of large-scale robot demonstration datasets.
• Work hands-on with bimanual and high-DoF manipulation data, including real teleoperation footage and sim-generated rollouts.
• Collaborate with partner labs to define data requirements and close the loop between data quality and downstream policy performance.
• Stay current on the research frontier and translate insights into production systems.

Skills

Vision-language models

Video understanding

Robot learning

Generative modeling

PyTorch

Distributed training

Publications impact

Education

MS or PhD in CS/Robotics/ML

Tools

PyTorch

Job description

XDOF is seeking a Research Engineer/Scientist to lead efforts at the intersection of vision-language models and robot learning. You will turn raw egocentric and teleoperation video into high-signal training data for VLA models and contribute to model development.

You will explore metadata and annotations to unlock capabilities across cross-embodiment transfer, curriculum generation, and world models, shaping data-driven robotics research into production systems.