Research Fellow / Engineer (Vision-Language Models) - WS1

Singapore Institute of Technology; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

The Singapore Institute of Technology is hiring a Research Fellow/Engineer to focus on vision-language models. The role involves managing an industry collaboration project, designing evaluation frameworks, and developing datasets. Successful candidates will have a PhD in Computer Science or a related field with expertise in computer vision, experience in ML evaluation metrics, and proficiency in Python and deep learning frameworks like PyTorch. This position offers an exciting opportunity to participate in applied, industry-collaborative research.

Qualifications

• PhD in Computer Science or related field.
• Expertise in computer vision and vision-language models.
• Experience with ML evaluation metrics and benchmarking.
• Proficiency in Python and deep learning frameworks (e.g., PyTorch).
• Interest in applied, industry-collaborative research.

Responsibilities

• Manage the research project to ensure all deliverables are met.
• Design and implement evaluation frameworks and metrics.
• Develop annotated video datasets and evaluation tasks.
• Build end-to-end evaluation pipelines and analysis tools.
• Prepare technical reports and publications.
• Mentor student assistants.
• Communicate with internal and external parties.
• Perform ad-hoc duties as assigned.

Skills

Expertise in computer vision and vision-language models

Experience with ML evaluation metrics and benchmarking

Proficiency in Python

Proficiency in deep learning frameworks (e.g., PyTorch)

Interest in applied, industry-collaborative research

Education

PhD in Computer Science or related field

Job description

Overview

Research Fellow / Engineer (Vision-Language Models) - WS1

Posting Start Date: 05/05/2026
Schemes of Service: Research
Division: Engineering
Employment Type: Fixed Term

As a University of Applied Learning, the Singapore Institute of Technology (SIT) works closely with industry in its research pursuits. This position is situated within the SIT x NVIDIA AI Centre (SNAIC).

This role is part of an industry innovation project with a large consumer goods company, where you will develop an evaluation framework for vision-language model (VLM) with applications in the personal care sector. The research focuses on fine-grained VLM capabilities such as spatial reasoning, temporal grounding, event tracking, and domain knowledge using a curated multimodal dataset.

Responsibilities

• Manage the research project together with the Principal Investigator (PI) and industry partner to ensure all project deliverables are met
• Design and implement evaluation frameworks and metrics for vision-language models
• Develop annotated video datasets and capability-tagged evaluation tasks
• Build end-to-end evaluation pipelines and failure mode analysis tools to analyze VLM performance across reasoning dimensions
• Prepare technical reports, publications, and industry-facing deliverables
• Mentor student assistants
• Candidates are to communicate with any internal or external parties to ensure project deliverables are met.
• Any other ad-hoc duties as assigned by Supervisor.

Requirements

• PhD in Computer Science or related field
• Expertise in computer vision and vision-language models
• Experience with ML evaluation metrics and benchmarking
• Proficiency in Python and deep learning frameworks (e.g., PyTorch)
• Interest in applied, industry-collaborative research