Italian AI Evaluation & Annotation Specialist - Remote

AuraOne Human Data

United States

Remote

USD 28,000 - 48,000

Part time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking an Italian-Language Audio/Voice Annotation Trainer to work remotely as an independent contractor. You will review Italian generalist evaluation prompts and responses, applying a versioned rubric and providing structured feedback for retraining the model.

Responsibilities include comparing outputs, tagging edge cases, and documenting recurring issues. Candidates should have prior annotation or evaluation experience and be able to work asynchronously for at least 10 hours

Qualifications

  • Experience evaluating Italian generalist evaluation or adjacent content.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning naming the issue and rubric clause.
  • Strong attention to detail and flag when a prompt is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Italian generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with tags.
  • Capture ambiguous prompts and route to the program team for rubric updates.
  • Calibrate reviewer quality against gold-standard examples weekly.
  • Document recurring failure modes for model retraining.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Italian generalist evaluation
Communication
Linguistics

Job description

AuraOne, Inc. is seeking an Italian-Language Audio/Voice Annotation Trainer to work remotely as an independent contractor. You will review Italian generalist evaluation prompts and responses, applying a versioned rubric and providing structured feedback for retraining the model.

Responsibilities include comparing outputs, tagging edge cases, and documenting recurring issues. Candidates should have prior annotation or evaluation experience and be able to work asynchronously for at least 10 hours

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Italian Audiobook QA Specialist
Remote Italian Audiobook QA Specialist

Auraone • United States

Remote
USD 21,000 - 28,000
Italian-Language Audio/Voice Annotation Trainer
Italian-Language Audio/Voice Annotation Trainer

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Remote Italian Music & Lyrics Evaluation Specialist
Remote Italian Music & Lyrics Evaluation Specialist

Auraone • United States

Remote
USD 28,000 - 50,000
Remote work
Remote Italian Bilingual Evaluator and Feedback Specialist
Remote Italian Bilingual Evaluator and Feedback Specialist

Auraone • United States

Remote
USD 18,000 - 26,000
Remote work
Italian AI Model Review Analyst — Remote Contractor
Italian AI Model Review Analyst — Remote Contractor

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Italian Evaluation Specialist (Remote) – Rubric QA
Italian Evaluation Specialist (Remote) – Rubric QA

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Italian Voice Acting Specialist for AI Training - Remote
Italian Voice Acting Specialist for AI Training - Remote

Meridial • United States

Remote
USD 8,300 - 90,000
Health insurance
PTO
Remote Italian Audio Evaluation Specialist
Remote Italian Audio Evaluation Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Italian Language Expert for AI Training
Remote Italian Language Expert for AI Training

Remotebridge • United States

Remote
USD 34,000 - 76,000
German Audio Annotation & Evaluation Specialist (Remote)
German Audio Annotation & Evaluation Specialist (Remote)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000