Persian Language Evaluator - Remote Evaluation & Feedback

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking a Persian Language Expert for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs, tagging issues with severity, and calibrating against gold-standard examples on a weekly cadence. Strong written reasoning is required.

Qualifications

• Experience evaluating Persian language content against rubrics.
• Ability to apply long multi-page rubrics consistently.
• Clear written reasoning naming issues and rubric clauses.

Responsibilities

• Evaluate Persian language evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label unsafe content and policy violations with structured tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Persian language evaluation

Annotation

Rubric-based annotation

Inter-rater calibration

Attention to detail

Async work

Job description

AI Trainer Jobs is seeking a Persian Language Expert for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs, tagging issues with severity, and calibrating against gold-standard examples on a weekly cadence. Strong written reasoning is required.