Remote Estonian Language Evaluator & Rubric Auditor

Auraone

United States

Remote

USD 34,000 - 69,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking an Estonian Language Expert for a remote evaluation track. You will review prompts and responses against AuraOne's rubric, compare outputs, label edge cases, and provide structured feedback to retrain models.

This is a contractor role, remote, with hourly pay confirmed after interview. You will work independently, approx 10+ hours per week, with flexible scheduling and strict attention to rubric application.

Qualifications

  • Experience evaluating Estonian language prompts and outputs.
  • Ability to apply multi-page rubrics consistently.
  • Strong written reasoning naming issues and rubric clauses.
  • Detail-oriented with ability to flag problematic prompts.
  • Available for at least 10 hours per week asynchronously.

Responsibilities

  • Evaluate Estonian model outputs against a versioned rubric and apply severity tags.
  • Compare paired responses and select the stronger answer with a rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with tags.
  • Capture ambiguous prompts and route to the rubric team for updates.
  • Maintain reviewer quality scores by calibration against gold-standard examples.

Skills

Estonian language evaluation
Annotation experience
Rubric-based evaluation
Attention to detail
Async availability

Job description

AI Trainer Jobs is seeking an Estonian Language Expert for a remote evaluation track. You will review prompts and responses against AuraOne's rubric, compare outputs, label edge cases, and provide structured feedback to retrain models.

This is a contractor role, remote, with hourly pay confirmed after interview. You will work independently, approx 10+ hours per week, with flexible scheduling and strict attention to rubric application.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Estonian Language Expert
Estonian Language Expert

Auraone • United States

Remote
USD 34,000 - 69,000
Remote Estonian AI Language Trainer
Remote Estonian AI Language Trainer

Meridial • United States

Remote
USD 11,000 - 90,000
Remote Russian Bilingual Evaluator & Rubric QA
Remote Russian Bilingual Evaluator & Rubric QA

Auraone • United States

Remote
USD 28,000 - 55,000
Remote work
Contractor role
Turkish Evaluation Specialist - Remote Quality Assurance
Turkish Evaluation Specialist - Remote Quality Assurance

Auraone • United States

Remote
USD 34,000 - 55,000
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
Remote Russian Evaluation & Rubric Auditor — Contractor
Remote Russian Evaluation & Rubric Auditor — Contractor

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Remote English Generalist Evaluator & Rubric Auditor
Remote English Generalist Evaluator & Rubric Auditor

AuraOne Human Data • United States

Remote
USD 28,000 - 138,000
Remote English Language Evaluation Specialist (Contractor)
Remote English Language Evaluation Specialist (Contractor)

AuraOne Human Data • United States

Remote
USD 34,000 - 69,000
Remote English Evaluation Specialist (Contractor)
Remote English Evaluation Specialist (Contractor)

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Remote Estonian Language Specialist & AI Trainer
Remote Estonian Language Specialist & AI Trainer

Meridial • United States

Remote
USD 11,000 - 90,000