Remote Mobile AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

AI Trainer Jobs is seeking a Remote Mobile Engineering AI Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

As an independent contractor, you will work on an hourly rate after interview, with flexible weekly hours and program-defined task volume. Prior evaluation or annotation experience is preferred, especially in mobile engineering AI evaluation.

Qualifications

• Prior evaluation, annotation, or human-rater experience on mobile engineering AI evaluation or adjacent content for Mobile Engineering AI Evaluator work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate mobile engineering ai evaluation model outputs against a versioned rubric and assign severity tags for Mobile Engineering AI Evaluator assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Model evaluation

Rubric annotation

Severity tagging

Inter-rater calibration

Mobile engineering AI evaluation

Software usage

AI evaluation

Rubric writing

Expert review

Job description

AI Trainer Jobs is seeking a Remote Mobile Engineering AI Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

As an independent contractor, you will work on an hourly rate after interview, with flexible weekly hours and program-defined task volume. Prior evaluation or annotation experience is preferred, especially in mobile engineering AI evaluation.