Italian AI Model Review Analyst — Remote Contractor

AuraOne Human Data

United States

Remote

USD 34,000 - 55,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne Human Data seeks an Italian-language Business Analyst for AI Model Review. This is a remote contractor role evaluating prompts and responses against a versioned rubric, labeling edge cases, and providing structured feedback for retraining.

You will compare paired outputs, justify selections, and tag content with the correct policies. Remote-US eligibility and 10+ hours weekly availability are required; hourly compensation is confirmed after interview.

Qualifications

  • Prior evaluation or annotation experience on Italian generalist evaluation.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning citing the rubric clause.
  • Strong attention to detail and ability to flag prompt problems.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate italian generalist evaluation model outputs against a rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples.
  • Document recurring failure modes for future training runs.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Italian generalist evaluation
Critical Thinking
Business Analysis

Job description

AuraOne Human Data seeks an Italian-language Business Analyst for AI Model Review. This is a remote contractor role evaluating prompts and responses against a versioned rubric, labeling edge cases, and providing structured feedback for retraining.

You will compare paired outputs, justify selections, and tag content with the correct policies. Remote-US eligibility and 10+ hours weekly availability are required; hourly compensation is confirmed after interview.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Italian-Language Business Analyst for AI Model Review
Italian-Language Business Analyst for AI Model Review

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Italian AI Evaluation & Annotation Specialist - Remote
Italian AI Evaluation & Annotation Specialist - Remote

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
German AI Model Review Analyst (Remote)
German AI Model Review Analyst (Remote)

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Italian Linguistic Expert
Italian Linguistic Expert

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Italian Bilingual Evaluator and Feedback Specialist
Remote Italian Bilingual Evaluator and Feedback Specialist

Auraone • United States

Remote
USD 18,000 - 26,000
Remote work
Italian-Language Audio/Voice Annotation Trainer
Italian-Language Audio/Voice Annotation Trainer

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Italian Evaluation Specialist (Remote) – Rubric QA
Italian Evaluation Specialist (Remote) – Rubric QA

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote Italian Audiobook QA Specialist
Remote Italian Audiobook QA Specialist

Auraone • United States

Remote
USD 21,000 - 28,000
Remote Italian Music & Lyrics Evaluation Specialist
Remote Italian Music & Lyrics Evaluation Specialist

Auraone • United States

Remote
USD 28,000 - 50,000
Remote work
Remote Italian Language QA & Alignment Partner
Remote Italian Language QA & Alignment Partner

Meridial • United States

Remote
USD 8,300 - 90,000