Remote Russian Music Audio QA & Evaluation Specialist

Auraone

United States

Remote

USD 48,000 - 85,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne is seeking a Music Audio Expert - Russian for a remote evaluation track. Reviewers assess russian generalist evaluation prompts and responses against a quality rubric, annotate with structured tags, and provide rationale for improvements.

The contractor role requires applying rubrics across long batches, maintaining calibration with gold-standard examples, and reporting issues for rubric updates. Remote with US eligibility, $35–$62 per hour.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on russian generalist evaluation or adjacent content for Music Audio Expert - Russian work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.
  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Responsibilities

  • Evaluate russian generalist evaluation model outputs against a versioned rubric and assign severity tags for Music Audio Expert - Russian assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Evaluation
Rubric tagging
Annotation
Inter-rater calibration
Russian generalist review

Job description

AuraOne is seeking a Music Audio Expert - Russian for a remote evaluation track. Reviewers assess russian generalist evaluation prompts and responses against a quality rubric, annotate with structured tags, and provide rationale for improvements.

The contractor role requires applying rubrics across long batches, maintaining calibration with gold-standard examples, and reporting issues for rubric updates. Remote with US eligibility, $35–$62 per hour.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Russian Bilingual Evaluator & Rubric QA
Remote Russian Bilingual Evaluator & Rubric QA

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Contractor role
Music Audio Expert - Russian
Music Audio Expert - Russian

Auraone • United States

Remote
USD 48,000 - 85,000
Remote Russian Evaluation & Rubric Auditor — Contractor
Remote Russian Evaluation & Rubric Auditor — Contractor

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Music & Lyrics Expert - Russian
Music & Lyrics Expert - Russian

Auraone • United States

Remote
USD 48,000 - 68,000
Korean Music Audio QA Specialist (Remote, Contractor)
Korean Music Audio QA Specialist (Remote, Contractor)

Auraone • United States

Remote
USD 48,000 - 85,000
Bilingual Russian Psychologist: AI Data Evaluator (Remote)
Bilingual Russian Psychologist: AI Data Evaluator (Remote)

Auraone • United States

Remote
USD 34,000 - 69,000
Remote Music Audio Expert (Japanese) – Evaluation & QA
Remote Music Audio Expert (Japanese) – Evaluation & QA

Auraone • United States

Remote
USD 48,000 - 85,000
Remote work
Contractor engagement
Audacity Audio QA Evaluator — Remote Contractor
Audacity Audio QA Evaluator — Remote Contractor

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote Russian Audio Annotation & QA Specialist
Remote Russian Audio Annotation & QA Specialist

Crossing Hurdles • United States

Remote
USD 141,000 - 248,000
Russian Linguistic Experts
Russian Linguistic Experts

AuraOne, Inc. • United States

Remote
USD 57,000 - 81,000