Remote Portuguese HR Documents Evaluator

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

AI Trainer Jobs is seeking a remote evaluator for Portuguese language HR document reviews. You will assess outputs against a quality rubric, label edge cases, and provide structured feedback to aid retraining.

The role involves comparing paired model outputs, tagging issues like hallucinations or policy violations, and maintaining calibration with gold-standard samples on a contractor basis. Remote work eligible for US-based candidates.

Qualifications

• Experience evaluating Portuguese generalist prompts or related content.
• Ability to apply structured feedback using rubrics.
• Familiarity with severity tagging and edge-case labeling.

Responsibilities

• Evaluate Portuguese outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger one with a rationale.
• Tag hallucinations, instruction-following failures, and unsafe content with structured categories.
• Capture ambiguous prompts and flag for rubric updates.
• Maintain reviewer-quality scores through calibration with gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Portuguese generalist evaluation

Job description

AI Trainer Jobs is seeking a remote evaluator for Portuguese language HR document reviews. You will assess outputs against a quality rubric, label edge cases, and provide structured feedback to aid retraining.

The role involves comparing paired model outputs, tagging issues like hallucinations or policy violations, and maintaining calibration with gold-standard samples on a contractor basis. Remote work eligible for US-based candidates.