Remote Russian Bilingual Evaluator & Rubric QA

Auraone

United States

Remote

USD 28,000 - 55,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work
Contractor role

Job summary

AI Trainer Jobs seeks a Russian bilingual expert to remotely review generalist evaluation prompts and responses against AuraOne's rubric. Reviewers compare paired outputs, label edge cases, and draft structured feedback for retraining.

As a remote contractor, you will help turn prompts into auditable labels, rationales, and regression cases, with hourly compensation discussed after interview and US eligibility confirmed.

Qualifications

  • Prior evaluation, annotation, or human-rater experience with Russian content.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning naming the issue and rubric clause applied.

Responsibilities

  • Evaluate Russian generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Model evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Russian language proficiency

Job description

AI Trainer Jobs seeks a Russian bilingual expert to remotely review generalist evaluation prompts and responses against AuraOne's rubric. Reviewers compare paired outputs, label edge cases, and draft structured feedback for retraining.

As a remote contractor, you will help turn prompts into auditable labels, rationales, and regression cases, with hourly compensation discussed after interview and US eligibility confirmed.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Bilingual Russian Psychologist: AI Data Evaluator (Remote)
Bilingual Russian Psychologist: AI Data Evaluator (Remote)

Auraone • United States

Remote
USD 34,000 - 69,000
Remote Russian Evaluation & Rubric Auditor — Contractor
Remote Russian Evaluation & Rubric Auditor — Contractor

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Russian Bilingual Expert
Russian Bilingual Expert

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Contractor role
Russian Linguistic Experts
Russian Linguistic Experts

AuraOne, Inc. • United States

Remote
USD 57,000 - 81,000
Remote Russian Music Audio QA & Evaluation Specialist
Remote Russian Music Audio QA & Evaluation Specialist

Auraone • United States

Remote
USD 48,000 - 85,000
Remote Chinese Evaluation & Rubric Specialist
Remote Chinese Evaluation & Rubric Specialist

AuraOne, Inc. • United States

Remote
USD 57,000 - 81,000
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
Bilingual Russian Psychologist (PhD)
Bilingual Russian Psychologist (PhD)

Auraone • United States

Remote
USD 34,000 - 69,000
Remote Estonian Language Evaluator & Rubric Auditor
Remote Estonian Language Evaluator & Rubric Auditor

Auraone • United States

Remote
USD 34,000 - 69,000
Remote English Generalist Evaluator & Rubric Auditor
Remote English Generalist Evaluator & Rubric Auditor

AuraOne Human Data • United States

Remote
USD 28,000 - 138,000