Remote English (India) AI Evaluation Specialist

Auraone

United States

Remote

USD 34,000 - 55,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking an English (India) Recording Specialist to remotely evaluate prompts and responses against AuraOne’s rubric. You will compare paired outputs, label edge cases, and document structured feedback to help retrain the model.

As a contractor, you will review frontier model outputs, tag severity, and calibrate against gold-standard examples on a weekly basis. Remote work with US eligibility is noted in the posting.

Qualifications

  • Experience evaluating model outputs using written rubrics.
  • Ability to apply structured tags for issues and severities.
  • Experience in auditing evaluator consistency and calibration.

Responsibilities

  • Evaluate english recording evaluation model outputs against a versioned rubric and assign severity tags for English (India) Recording Specialist assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
English Recording evaluation

Job description

AI Trainer Jobs is seeking an English (India) Recording Specialist to remotely evaluate prompts and responses against AuraOne’s rubric. You will compare paired outputs, label edge cases, and document structured feedback to help retrain the model.

As a contractor, you will review frontier model outputs, tag severity, and calibrate against gold-standard examples on a weekly basis. Remote work with US eligibility is noted in the posting.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote English Audio Evaluation Specialist
Remote English Audio Evaluation Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
Remote English & Odia Evaluation Specialist
Remote English & Odia Evaluation Specialist

Auraone • United States

Remote
USD 21,000 - 28,000
Remote English Voice Evaluation Specialist
Remote English Voice Evaluation Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
Remote Evaluation Specialist: English & Telugu
Remote Evaluation Specialist: English & Telugu

Auraone • United States

Remote
USD 21,000 - 28,000
Remote English & Tamil Evaluation Specialist
Remote English & Tamil Evaluation Specialist

Auraone • United States

Remote
USD 21,000 - 28,000
Contractor
Remote work
Remote English Voice Evaluation Specialist (US Contractor)
Remote English Voice Evaluation Specialist (US Contractor)

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
AI English Language Evaluator — Remote Review Specialist
AI English Language Evaluator — Remote Review Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 69,000
Remote AI Data Evaluator, English & Assamese
Remote AI Data Evaluator, English & Assamese

Auraone • United States

Remote
USD 21,000 - 28,000
Remote work
Contractor flexibility
Remote English Audio Annotation Specialist (UK)
Remote English Audio Annotation Specialist (UK)

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000