Remote EE AI Evaluator & Rubric Annotator

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AI Trainer Jobs in the United States invites an Electrical Engineering AI Evaluator to remotely review prompts and responses against AuraOne's rubric. You compare paired outputs, label edge cases, and write structured feedback for retraining the modeling team.

As an independent contractor, you will evaluate model outputs, tag issues, and calibrate against gold-standard examples. Flexible hours and strong attention to detail are essential.

Qualifications

• Experience evaluating AI prompts and outputs against rubrics.
• Ability to apply rubric clauses consistently across batches.
• Strong written reasoning to name issues and rubric clauses.

Responsibilities

• Evaluate electrical engineering AI evaluation outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Evaluation experience

Rubric application

Attention to detail

Written reasoning

Asynchronous availability

Electrical engineering knowledge

Tools

Inter-rater calibration

Job description

AI Trainer Jobs in the United States invites an Electrical Engineering AI Evaluator to remotely review prompts and responses against AuraOne's rubric. You compare paired outputs, label edge cases, and write structured feedback for retraining the modeling team.

As an independent contractor, you will evaluate model outputs, tag issues, and calibrate against gold-standard examples. Flexible hours and strong attention to detail are essential.