Research Fellow / Engineer (Vision-Language Models) - WS1

Singapore Institute of Technology; Singapore; On-site; SGD 60,000 - 100,000; Full time

Job summary

Singapore Institute of Technology (SIT) is seeking a Research Fellow / Engineer (Vision-Language Models) to advance evaluation frameworks for multimodal models within the SIT x NVIDIA AI Centre (SNAIC). You will collaborate with industry partners on a personal care dataset, shaping study design and metrics for spatial reasoning and temporal grounding.

The role involves coordinating with academia and industry, developing pipelines, and mentoring student assistants while contributing to reports

Qualifications

• PhD in Computer Science or related field.
• Expertise in computer vision and vision-language models.
• Experience with ML evaluation metrics and benchmarking.
• Proficiency in Python and PyTorch.
• Interest in applied, industry-collaborative research.

Responsibilities

• Manage the research project with the PI and industry partner to ensure deliverables are met.
• Design and implement evaluation frameworks and metrics for vision-language models.
• Develop annotated video datasets and capability-tagged evaluation tasks.
• Build end-to-end evaluation pipelines and failure mode analysis tools for VLM performance across reasoning dimensions.
• Prepare technical reports, publications, and industry-facing deliverables.
• Mentor student assistants.
• Communicate with internal or external parties to ensure project deliverables are met.
• Perform ad-hoc duties as assigned by Supervisor.

Skills

Computer vision

Vision-language models

ML evaluation metrics

Python

PyTorch

Education

PhD in Computer Science or related field

Tools

Python

PyTorch

Job description

Research Fellow / Engineer (Vision-Language Models) - WS1 Job Description Research Fellow / Engineer (Vision-Language Models) - WS1 Posting Start Date: 05/05/2026 Schemes of Service: Research Division: Engineering Employment Type: Fixed Term

As a University of Applied Learning, the Singapore Institute of Technology (SIT) works closely with industry in its research pursuits. This position is situated within the SIT x NVIDIA AI Centre (SNAIC).

This role is part of an industry innovation project with a large consumer goods company, where you will develop an evaluation framework for vision-language model (VLM) with applications in the personal care sector. The research focuses on fine-grained VLM capabilities such as spatial reasoning, temporal grounding, event tracking, and domain knowledge using a curated multimodal dataset.

Key Responsibilities

• Manage the research project together with the Principal Investigator (PI) and industry partner to ensure all project deliverables are met
• Design and implement evaluation frameworks and metrics for vision-language models
• Develop annotated video datasets and capability-tagged evaluation tasks
• Build end-to-end evaluation pipelines and failure mode analysis tools to analyze VLM performance across reasoning dimensions
• Prepare technical reports, publications, and industry-facing deliverables
• Mentor student assistants
• Candidates are to communicate with any internal or external parties to ensure project deliverables are met.
• Any other ad-hoc duties as assigned by Supervisor.

Requirements

• PhD in Computer Science or related field
• Expertise in computer vision and vision-language models
• Experience with ML evaluation metrics and benchmarking
• Proficiency in Python and deep learning frameworks (e.g., PyTorch)
• Interest in applied, industry-collaborative research

Copyright © 2025 Singapore Institute of Technology. All Rights Reserved.