Data & Evaluation Lead, Video AI Models

Cantina, Inc.; Singapore; Remote; SGD 150,000 - 230,000; Full time

Benefits offered by this job

Competitive salary

Equity

Health insurance

Global travel insurance

Monthly stipend

Home office equipment

Job summary

Cantina Labs in Singapore is seeking a Member of Technical Staff to shape the data and evaluation strategies behind its video generation models. You will own the full data lifecycle—from defining data requirements to building high‑quality datasets and evaluating outputs.

Collaborate with research scientists, ML engineers, product teams, and external partners to translate findings into model improvements. Experience with data strategy, annotation, and multimodal evaluation is desired.

Qualifications

• Experience with data strategy, dataset development, annotation, or model evaluation for generative video or multimodal models.
• Experience supporting model development across continued training, supervised fine‑tuning, or evaluation.
• Strong understanding of generative media tasks, including image/video generation and instruction‑based editing.
• Experience developing labeling taxonomies, guidelines, and evaluation frameworks.
• Ability to translate subjective quality into measurable data and evaluation standards.
• Experience managing large‑scale data production and collaborating across teams.

Responsibilities

• Define quality standards for video generation across aesthetics, realism, composition, motion, and text rendering.
• Evaluate model iterations and translate findings into actionable data, training, and prompting strategies.
• Own end‑to‑end training data projects: sourcing, construction, annotation, captioning, quality control, and delivery.
• Develop labeling systems for dataset segmentation, coverage analysis, quality filtering, and model attribution.
• Design annotation and captioning standards for video generation, editing, and multi‑reference tasks.
• Create and evaluate synthetic‑data workflows based on stability, usability, quality, and training value.
• Develop automated annotation and filtering workflows using vision‑language models and prompts.
• Build structured model evaluation processes covering test‑set design, evaluation criteria, and reporting.
• Establish feedback loops linking evaluation with data strategy and model iteration.

Skills

Data strategy

Dataset development

Annotation

Model evaluation

Multimodal models

Vision–language tools

Python

SQL

Tools

Python

SQL

Job description

Cantina Labs in Singapore is seeking a Member of Technical Staff to shape the data and evaluation strategies behind its video generation models. You will own the full data lifecycle—from defining data requirements to building high‑quality datasets and evaluating outputs.

Collaborate with research scientists, ML engineers, product teams, and external partners to translate findings into model improvements. Experience with data strategy, annotation, and multimodal evaluation is desired.