Remote AI Quality Analyst, Personalization (Russian)

AuraOne Human Data

United States

Remote

USD 18,000 - 23,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking an AI Quality Analyst (Personalization) for a remote, contractor-based role focused on evaluating Russian generalist outputs. You will apply a versioned rubric, label errors, and provide structured feedback to help retrain models.

Strong written reasoning and attention to detail are essential to maintain high reviewer quality. Responsibilities include comparing responses, tagging issues, and documenting failure patterns to drive improvements in AI quality and safety

Qualifications

  • Prior evaluation or annotation experience on Russian generalist evaluation.
  • Ability to apply multi-page rubrics consistently.
  • Clear written reasoning citing rubric clauses.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate russian generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and provide a rationale for the stronger answer.
  • Label hallucinations, instruction-following, and unsafe content with the correct tags.
  • Capture ambiguous prompts and suggest rubric updates.
  • Calibrate reviewer-quality scores against gold-standard examples weekly.
  • Document recurring failure modes for model training.

Skills

Attention to detail
Clear reasoning
Async availability
Model evaluation
Rubric annotation
Severity tagging
Inter-rater calibration
Russian proficiency

Job description

AuraOne, Inc. is seeking an AI Quality Analyst (Personalization) for a remote, contractor-based role focused on evaluating Russian generalist outputs. You will apply a versioned rubric, label errors, and provide structured feedback to help retrain models.

Strong written reasoning and attention to detail are essential to maintain high reviewer quality. Responsibilities include comparing responses, tagging issues, and documenting failure patterns to drive improvements in AI quality and safety

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Quality Analyst (Personalization) - Polish Expert
Remote AI Quality Analyst (Personalization) - Polish Expert

AuraOne Human Data • United States

Remote
USD 23,000 - 32,000
AI Quality Analyst (Personalization) - Russian
AI Quality Analyst (Personalization) - Russian

AuraOne Human Data • United States

Remote
USD 18,000 - 23,000
Remote AI Quality Analyst: Personalization (Portuguese)
Remote AI Quality Analyst: Personalization (Portuguese)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Analyst, Personalization (Arabic)
Remote AI Quality Analyst, Personalization (Arabic)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Analyst (Spanish, Personalization)
Remote AI Quality Analyst (Spanish, Personalization)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote AI Quality Analyst, Personalization (Vietnamese)
Remote AI Quality Analyst, Personalization (Vietnamese)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote work in US
Flexible hours
Remote AI Quality Analyst – Turkish Personalization
Remote AI Quality Analyst – Turkish Personalization

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Russian-Language AI Evaluation Specialist
Remote Russian-Language AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
German AI Quality Analyst, Personalization Review (Remote)
German AI Quality Analyst, Personalization Review (Remote)

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote work (US-eligible)
Independent contractor
Remote AI Image Quality Reviewer & Rubric Specialist
Remote AI Image Quality Reviewer & Rubric Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000