Remote Russian–English Model Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Russian-English Language Evaluation Specialist to remotely review prompts and responses against its quality rubric. You will compare outputs, label edge cases, and provide structured feedback that informs retraining for the modeling team.

As a contractor, you will help turn evaluation results into auditable labels, rationales, and regression cases while maintaining high attention to detail and clear written reasoning.

Qualifications

• Experience evaluating model outputs against rubrics.
• Ability to label edge cases and provide structured feedback.
• Comfort working with multi-page rubrics and batch reviews.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and justify the stronger answer.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and flag for rubric updates.

Skills

Attention to detail

Written reasoning

Linguistic evaluation

Inter-rater calibration

Tools

Rubric-based annotation

Categorization tagging

Job description

AuraOne is seeking a Russian-English Language Evaluation Specialist to remotely review prompts and responses against its quality rubric. You will compare outputs, label edge cases, and provide structured feedback that informs retraining for the modeling team.

As a contractor, you will help turn evaluation results into auditable labels, rationales, and regression cases while maintaining high attention to detail and clear written reasoning.