Remote Embodied Navigation Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 28,000 - 41,000; Full time

Benefits offered by this job

Remote work

Contractor role

Job summary

AI Trainer Jobs is seeking a remote Embodied Navigation Failure Case Reviewer to assess prompts and responses against AuraOne's rubric. You will compare outputs, label edge cases, and produce structured feedback to retrain the model.

As an independent contractor, the hourly rate will be confirmed after the interview. The role requires US eligibility for remote work and a commitment of approximately 10 hours per week.

Qualifications

• Prior evaluation, annotation, or human-rater experience on embodied navigation failure case evaluation.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate embodied navigation failure case evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Job description

AI Trainer Jobs is seeking a remote Embodied Navigation Failure Case Reviewer to assess prompts and responses against AuraOne's rubric. You will compare outputs, label edge cases, and produce structured feedback to retrain the model.

As an independent contractor, the hourly rate will be confirmed after the interview. The role requires US eligibility for remote work and a commitment of approximately 10 hours per week.