Vision-Language Robotics Data Systems Engineer

XDOF; San Mateo (CA); On-site; USD 130,000 - 210,000; Full time

Job summary

XDOF is hiring a Research Engineer / Scientist to lead systems that convert raw egocentric and teleoperation video into high-signal training data for vision-language models and robot learning.

You will design scalable VL pipelines, advance data curation, and collaborate with partner labs to align data quality with policy performance, shaping the future of robotics and AI.

Requires MS or PhD and 3–7 years of relevant experience; deep PyTorch expertise; work across perception, language, and action.

Qualifications

• MS or PhD in Computer Science, Robotics, Machine Learning, or related field from a top-tier program
• 3-7 years of research or applied research experience in vision-language models, video understanding, robot learning, or generative modeling
• Deep fluency in PyTorch; working knowledge of large-scale training infrastructure (distributed training, mixed precision, large batch workflows)
• Published work or demonstrable impact in VLMs/VLAs, video representation learning, imitation learning, or a closely related area
• Strong engineering fundamentals — you can design clean systems, not just run experiments

Responsibilities

• Design and implement vision-language pipelines for egocentric and teleoperation video: structured captioning, temporal grounding, action-conditioned scene understanding, and semantic annotation at scale
• Develop and evaluate representations that bridge visual perception, language, and low-level robot action - spanning VLAs, video prediction, and world models
• Build and improve data curation systems that assess quality, diversity, and coverage of large-scale robot demonstration datasets
• Work hands-on with bimanual and high-DoF manipulation data, including real teleoperation footage and sim-generated rollouts
• Collaborate directly with partner labs to define data requirements and close the loop between data quality and downstream policy performance
• Stay current on the research frontier (VLAs, video foundation models, flow matching, DiT architectures, egocentric pretraining) and translate insights into production systems

Skills

Vision-language models

Robot learning

Video understanding

Generative modeling

Strong engineering fundamentals

Education

MS or PhD in CS/Robotics/ML?

Tools

PyTorch

Distributed training

Mixed precision

Large-batch workflows

Job description

XDOF is hiring a Research Engineer / Scientist to lead systems that convert raw egocentric and teleoperation video into high-signal training data for vision-language models and robot learning.

You will design scalable VL pipelines, advance data curation, and collaborate with partner labs to align data quality with policy performance, shaping the future of robotics and AI.

Requires MS or PhD and 3–7 years of relevant experience; deep PyTorch expertise; work across perception, language, and action.