VR & Multimodal HRI Research Engineer

HYPERSCAL SOLUTIONS PTE. LTD.; Dublin; On-site; EUR 48,000 - 72,000; Full time

Job summary

Singapore Management University invites applications for a research role focused on advancing a multimodal VR environment. The candidate will extend a VR lab’s testbed, integrating speech, gaze, and gesture with real-time processing and a scene-graph representation of tasks.

Responsibilities include designing and running controlled lab studies, analyzing data, and co-authoring publications in CHI and related venues. The role requires collaboration in a small, agile, academic team.

Qualifications

• Master's degree in Computer Science, IT, IS or related field, with focus on Human-Robot Interaction.
• 1 year of relevant research experience in Human-Robot Interaction as graduate student, RA or researcher.
• Proficiency in C# and Python; Unity environment required.
• Hands-on VR development experience (Quest, OpenXR) including eye- and hand-tracking.
• Experience integrating real-time multimodal inputs and LLM/VLM APIs.
• Proven experience in interface prototyping and user study design.
• Academic research background, literature review, and manuscript preparation.
• Experience in designing robotic interaction methods and coordinating experiments.
• Ability to break down complex problems and innovate.

Responsibilities

• Extend and maintain the lab's VR testbed (Unity frontend, Python backend).
• Integrate live speech recognition, eye tracking, hand tracking, and scene-graph representations.
• Build a multimodal reference resolver with low latency (<200 ms).
• Create in-situ visual overlays showing the agent's belief and integrate with policies.
• Plan and conduct controlled lab studies (N≈24-48) including IRB prep.
• Analyze quantitative and qualitative study data; contribute to papers.
• Develop and release an expanded public corpus of natural deictic instructions.
• Perform other duties as assigned.

Skills

Human-robot interaction

Team collaboration

Experiment design

Education

Master's degree in Computer Science / Information Technology / Information Systems with focus on HRI

Tools

C#

Python

Unity

OpenXR

Eye-tracking

Hand-tracking

Speech recognition

Job description

Singapore Management University invites applications for a research role focused on advancing a multimodal VR environment. The candidate will extend a VR lab’s testbed, integrating speech, gaze, and gesture with real-time processing and a scene-graph representation of tasks.

Responsibilities include designing and running controlled lab studies, analyzing data, and co-authoring publications in CHI and related venues. The role requires collaboration in a small, agile, academic team.