Robot & Human Action Outcome Evaluator

ixolabs.ai; France; Hybride; EUR 24 000 - 102 000; Plein temps

Résumé du poste

IXO Evaluate is looking for meticulous annotators to review robotics and human-activity footage, applying a written directive and rubric to determine whether each clip meets the requested end state.

You will label objects, actions and transitions, explain ambiguities, and note uncertainty, while ensuring consistency across annotations. This remote role emphasizes careful visual reasoning and precise feedback.

Qualifications

• This track relies on careful visual reasoning: understanding a written directive, following a sequence of actions and explaining whether the final state satisfies the request.

Responsabilités

• Inspect the observed actions and outcomes against the written task and rubric.
• Label relevant objects, actions, events and transitions with consistent descriptions.
• Explain ambiguous cases and correct labels that do not match the footage.
• Review quality and incorporate feedback into subsequent annotations.
• Compare two clips and determine which better reaches the requested end state.
• Repair AI-generated action boundaries, descriptions and feedback, noting subtle movement and object interactions.

Description du poste

Your work at IXO Evaluate robotics and human-activity footage for IXO action-understanding data.

Responsibilities

• Inspect the observed actions and outcomes against the written task and rubric.
• Label relevant objects, actions, events and transitions with consistent descriptions.
• Explain ambiguous cases and correct labels that do not match the footage.
• Review quality and incorporate feedback into subsequent annotations.
• Compare two clips and determine which better reaches the requested end state.
• Repair AI-generated action boundaries, descriptions and feedback, noting subtle movement and object interactions.

Profile

This track relies on careful visual reasoning: understanding a written directive, following a sequence of actions and explaining whether the final state satisfies the request. You should apply a rubric consistently and communicate subtle differences clearly; prior AI work is not required.

Deliverables and pay

Outputs are annotated clips, supported scores, corrected boundaries where applicable, and clear uncertainty notes. IXO will agree the scope, schedule and review criteria before work begins.

Pay is $20 • $85/hr in USD. Work is remote.