Multimodal Action & Skill Understanding Intern

Honda Ri; San Jose (CA); On-site; USD 33,000 - 47,000; Full time

Job summary

Honda Research Institute USA in San Jose, CA invites a research intern to advance multimodal action understanding in long procedural activities. You will fuse video, pose, force/tactile signals, and other modalities to estimate proficiency and segment actions.

The role offers collaboration on publications and potential patents. The internship requires an MS/PhD in robotics, CV, ML, or AI, strong PyTorch skills, and the ability to work independently and communicate clearly.

Qualifications

• Currently enrolled in an M.S. or Ph.D. program in Robotics, Computer Vision, Machine Learning, Artificial Intelligence, or a closely related field.
• Experience with video understanding and temporal modeling, including modern video encoders or multimodal foundation models.
• Experience combining video with at least one non-visual modality (pose, IMU, force/tactile, audio).
• Strong programming skills and proficiency in PyTorch, with the ability to write clean, reproducible research code.
• Ability to independently drive a project from ideation to experimentation (and optionally publication).
• Strong written and verbal communication skills.

Responsibilities

• Design and implement multimodal methods for temporal action segmentation and proficiency estimation in long, untrimmed procedural recordings, combining multiview video with pose, force, and/or tactile signals.
• Develop approaches for learning across modalities to improve vision-only inference.
• Build skill representations that connect what a person does with how well they do it, and study how they transfer across tasks and viewpoints and sensor configurations.
• Benchmark rigorously, conduct error analysis, and build tooling for reproducible experimentation.
• Collaborate with the team and contribute to publications (e.g., CVPR, ICCV, ECCV, NeurIPS) and patents.

Skills

Video understanding

Temporal modeling

PyTorch

Research coding

Independent project drive

Communication

Multimodal fusion

Education

M.S. or Ph.D. in Robotics/Computer Vision/ML/AI or related field

Tools

PyTorch

Job description

Honda Research Institute USA in San Jose, CA invites a research intern to advance multimodal action understanding in long procedural activities. You will fuse video, pose, force/tactile signals, and other modalities to estimate proficiency and segment actions.

The role offers collaboration on publications and potential patents. The internship requires an MS/PhD in robotics, CV, ML, or AI, strong PyTorch skills, and the ability to work independently and communicate clearly.