QC Reviewer-Video Annotation(Philippines)

Welo Data; United States; Remote; USD 55,000 - 75,000; Full time

Job summary

Welo Data is seeking a meticulous QC reviewer to assess robot annotation videos. You will verify annotation accuracy across three labeling levels and multiple camera views, ensuring descriptions reflect what happened, including failures or slips.

Strong English writing skills and prior QC/review experience are highly valued. This role emphasizes precise language, consistent terminology, and actionable feedback in a collaborative, fast-paced environment.

Qualifications

• Excellent written English with strong reading comprehension.
• Ability to catch subtle mismatches between video content and text.
• Experience in QC, editing, proofreading, or annotation review preferred.

Responsibilities

• Review annotations across three labeling levels on video data.
• Cross-check descriptions against multiple camera views for accuracy.
• Identify labeling gaps and flag smoothed or incorrect outcomes.
• Provide actionable feedback referencing the style guide.
• Document review outcomes and patterns for calibration.

Skills

Attention to detail

English proficiency

QC experience

Education

Bachelor's degree or equivalent

Tools

Label Studio

Job description

What You'll Do

• Review completed annotations of robot manipulation videos across three levels of labeling detail (atomic motion, skill/subtask, task/goal).
• Cross-check annotator descriptions against all three camera views (overhead and both wrist-mounted cameras) to verify accuracy of described actions, object identification, and contact/grasp details.
• Verify full coverage of each video — confirm there are no gaps in labeling, including idle or pause moments.
• Check that descriptions accurately reflect whatactually happenedin the video, including failures, drops, or slipped grips — flagging any instances where outcomes were inaccurately described or "smoothed over".
• Evaluate annotations for adherence to the style guide: correct vocabulary usage, spatial/directional accuracy, consistent terminology for objects and actions, andappropriate languagevariation (avoiding repetitive phrasing).
• Identifyrecurring errors or patterns of confusion among annotators and report them to theteamleadfor calibration purposes.
• Provide specific, actionable feedback on rejected or revised annotations, referencing the style guide and reference examples.
• Participate in periodic calibration sessions with the team andclientto align QC standards with evolving guidelines oredge-caseresolutions.
• Maintain a QC log or tracking sheet documenting review outcomes, common error types, and annotator performance trends (as required by the project).

What We're Looking For

Required:

• Excellent written English and strong reading comprehension —you'llbe evaluating precise, nuanced language choices, not just checking for typos.
• Exceptional attention to detail — able to catch subtle mismatches between video content and written description (e.g., a mislabeled grasp type, an incorrect object part, a missed failure event).

Nice to Have:

• Prior experience in a QC, editing, proofreading, or annotation review role.
• Experience with video annotation, data labeling, or transcription QA specifically.
• Familiarity with robotics terminology (grippers, end-effectors, manipulation).
• Experience with annotation tools such as Label Studio, including review/approval workflows.