Video Data & Model Evaluation Specialist

CANTINA RESEARCH SINGAPORE PTE. LTD.

Singapore

On-site

SGD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Health insurance
Travel insurance
Stipend
Home office equipment

Job summary

Cantina Labs is seeking a Member of Technical Staff to shape data and evaluation for video-generation models in its Singapore research team. You will own the full data lifecycle, from defining requirements to building datasets, evaluating outputs, and translating findings into actionable improvements.

You will work with researchers, engineers, product teams, and external partners to strengthen the data–model–evaluation feedback loop and drive end-to-end data initiatives for future capabilities.

Qualifications

  • Hands-on data strategy and dataset development.
  • Experience with generative image/video/multimodal models.
  • Ability to define annotation standards and quality thresholds.
  • Experience coordinating large data projects with multiple teams.

Responsibilities

  • Define quality standards for video generation across aesthetics, realism, composition, motion, temporal consistency, instruction following, subject consistency, editing preservation, and text rendering.
  • Evaluate model iterations, analyze failure patterns, and translate findings into actionable data, training, and prompting strategies.
  • Own end-to-end training data projects, including sourcing, construction, annotation, captioning, quality control, and delivery.
  • Develop labeling systems that support dataset segmentation, coverage analysis, quality filtering, training-data mixtures, and model performance attribution.
  • Design annotation and captioning standards for video generation, editing, and multi-reference tasks.
  • Create and evaluate synthetic-data workflows based on their stability, usability, quality, and training value.
  • Develop automated annotation and filtering workflows using vision-language models, system prompts, and quality-scoring models.
  • Build structured model evaluation processes covering test-set design, evaluation criteria, failure attribution, and reporting.
  • Establish feedback loops connecting model evaluation and negative-case analysis with data strategy and model iteration.
  • Train and calibrate annotation teams and external data partners, conduct quality audits, and improve delivery standards.
  • Partner with research, engineering, product, and creative teams to execute data initiatives and identify future model capabilities.

Skills

Data strategy
Dataset development
Annotation
Model evaluation
Multimodal data
Labeling taxonomies
Python/SQL scripting

Tools

Python
SQL

Job description

Cantina Labs is seeking a Member of Technical Staff to shape data and evaluation for video-generation models in its Singapore research team. You will own the full data lifecycle, from defining requirements to building datasets, evaluating outputs, and translating findings into actionable improvements.

You will work with researchers, engineers, product teams, and external partners to strengthen the data–model–evaluation feedback loop and drive end-to-end data initiatives for future capabilities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Video Data & Model Evaluation Engineer
Staff Video Data & Model Evaluation Engineer

Cantina • Singapore

On-site
SGD 120,000 - 180,000
Competitive salary and generous equity
Personal time off and paid holidays
Health insurance
+3
Data & Evaluation Lead, Video AI Models
Data & Evaluation Lead, Video AI Models

Cantina, Inc. • Singapore

Remote
SGD 150,000 - 230,000
Competitive salary
Equity
Health insurance
+3
Staff Data & Evaluation Lead, Video AI
Staff Data & Evaluation Lead, Video AI

Speedrun Talent Network • Singapore

On-site
SGD 120,000 - 180,000
Competitive salary
Equity
Personal time off and holidays
+4
Member of Technical Staff, Video Data & Model Evaluation Research - Singapore - Full Time - Remote
Member of Technical Staff, Video Data & Model Evaluation Research - Singapore - Full Time - Remote

Cantina, Inc. • Singapore

Remote
SGD 150,000 - 230,000
Competitive salary
Equity
Health insurance
+3
Member of Technical Staff, Video Data & Model Evaluation
Member of Technical Staff, Video Data & Model Evaluation

Speedrun Talent Network • Singapore

On-site
SGD 120,000 - 180,000
Competitive salary
Equity
Personal time off and holidays
+4
Member of Technical Staff, Video Data & Model Evaluation
Member of Technical Staff, Video Data & Model Evaluation

Cantina • Singapore

On-site
SGD 120,000 - 180,000
Competitive salary and generous equity
Personal time off and paid holidays
Health insurance
+3
Member of Technical Staff, Video Data & Model Evaluation
Member of Technical Staff, Video Data & Model Evaluation

CANTINA RESEARCH SINGAPORE PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Equity
Health insurance
Travel insurance
+2
Visual Data Curator for AI Video Models
Visual Data Curator for AI Video Models

AI Chopping Block, Inc. • Singapore

On-site
SGD 60,000 - 90,000
Competitive salary
Company equity
Paid time off
+4
Visual Data Curator for AI Video and Multimodal Models
Visual Data Curator for AI Video and Multimodal Models

Cantina • Singapore

On-site
SGD 60,000 - 90,000
Company equity
Paid time off
Health insurance
+3
Video AI Research Scientist — Systems & Distillation
Video AI Research Scientist — Systems & Distillation

Speedrun Talent Network • Singapore

On-site
SGD 180,000 - 260,000
Competitive salary
Equity
Personal time off and paid holidays
+4