Generative Video Content Evaluation Engineer

Vamp; Singapore; On-site; SGD 89,000 - 134,000; Full time

Job summary

Vamp is seeking a Content Engineer to join our Content Content Engineering team. You will own the human evaluation layer for image and video generation quality, design rubrics, run evaluation rounds, and craft writeups that translate subjective judgments into measurable signals shaping model behavior and launch decisions.

You must have hands-on video production experience and the craft vocabulary to describe media quality precisely.

Qualifications

• Six plus years of experience in video production, content strategy, media evaluation or related fields.
• Hands-on video production experience and ability to describe quality failures precisely.
• Experience creating or contributing to evaluation rubrics or quality guidelines for video or image content.
• Experience producing or evaluating short-form video and emerging formats.
• Ability to document judgment logic into reusable, scalable frameworks.
• Experience leveraging quantitative insights to inform content and quality decisions.
• Experience collaborating with cross-functional teams (product, engineering, design, research, analytics).
• Experience working independently and navigating ambiguity in fast-paced environments.
• Bachelor’s degree in a related field or equivalent experience.

Responsibilities

• Build and maintain evaluation rubrics for image and video generation quality.
• Execute human evaluation rounds and produce clear, actionable writeups.
• Construct and curate prompt sets and golden sets for stress-testing model capabilities.
• Calibrate with raters and vendor teams; improve inter-rater reliability.
• Help translate evaluation findings into training and post-training signals.
• Support the transition of human judgment into automated measurement.
• Track quality trends across model versions and flag regressions early.
• Deliver high-quality evaluation work on timelines in a fast-paced environment.

Skills

Video production

Editorial standards

Content evaluation

Cross-functional collaboration

Independent work

Education

Bachelor's degree

Tools

Annotation platforms

Evaluation tooling

Job description

Vamp is seeking a Content Engineer to join our Content Content Engineering team. You will own the human evaluation layer for image and video generation quality, design rubrics, run evaluation rounds, and craft writeups that translate subjective judgments into measurable signals shaping model behavior and launch decisions.

You must have hands-on video production experience and the craft vocabulary to describe media quality precisely.