Research Engineer - VR & Multimodal HRI

Times Higher Education; Singapore; On-site; SGD 65,000 - 90,000; Full time

Job summary

Singapore Management University is seeking a researcher for the School of Computing and Information Systems to extend a VR lab testbed using Unity and Python, integrating speech, eye tracking, and hand tracking with a scene-graph representation of the task environment.

Responsibilities include designing and running controlled lab studies, analyzing data, and contributing to manuscript submissions to CHI, UIST, DIS, CSCW, or HRI, plus releasing a public corpus of deictic instructions.

Qualifications

• Master's degree in CS/IT/IS or related with focus on Human-Robot Interaction.
• 1 year of relevant research in HRI as student or staff.
• Proficiency in C# and Python and Unity experience.
• Experience VR headsets and real-time multimodal input pipelines.

Responsibilities

• Extend and maintain the lab's VR testbed (Unity front-end, Python back-end) with speech, eye and hand tracking.
• Implement multimodal reference resolver with real-time latency under 200 ms.
• Design and implement in-situ visual overlays showing the agent's belief state.
• Design, pilot and run lab user studies (N≈24-48) with logging and IRB docs.
• Analyse quantitative and qualitative study data and co-author submissions to venues.
• Collect and release an expanded corpus of natural deictic instructions.
• Other duties as assigned.

Skills

C#

Python

Unity

VR development

Multimodal integration

Experimental design

Statistical analysis

HCI/HRI pubs

Team collaboration

Education

Master's degree in Computer Science / related

Tools

OpenXR

LLM APIs

Speech recognition

Eye tracking

Gesture tracking

Job description

Singapore Management University is seeking a researcher for the School of Computing and Information Systems to extend a VR lab testbed using Unity and Python, integrating speech, eye tracking, and hand tracking with a scene-graph representation of the task environment.

Responsibilities include designing and running controlled lab studies, analyzing data, and contributing to manuscript submissions to CHI, UIST, DIS, CSCW, or HRI, plus releasing a public corpus of deictic instructions.