Remote L&D Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

AI Trainer Jobs is seeking a remote Training / onboarding / L&D Evaluator to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the structured feedback the modeling team can use to retrain.

This independent contractor role requires strong attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week. Compensation is $80–$120 per hour, US-eligible, remote.

Qualifications

• Prior evaluation, annotation, or human-rater experience on training / onboarding / L&D evaluation.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause being applied.
• Strong attention to detail and flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate training / onboarding / L&D evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Evaluation experience

Annotation experience

Multi-page rubric application

Clear written reasoning

Attention to detail

Async availability

Job description

AI Trainer Jobs is seeking a remote Training / onboarding / L&D Evaluator to review prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the structured feedback the modeling team can use to retrain.

This independent contractor role requires strong attention to detail, clear written reasoning, and the ability to work asynchronously for at least 10 hours per week. Compensation is $80–$120 per hour, US-eligible, remote.