Remote Indonesian AI Evaluation Specialist

AuraOne Human Data

United States

Remote

USD 17,000 - 24,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne Human Data is seeking a Bahasa Indonesian AI Evaluation Specialist to remotely assess Indonesian generalist prompts and responses against a quality rubric. You will compare outputs, provide written rationales, and tag edge cases to help retrain and improve our evaluation system.

This independent contractor role requires reliable async availability for at least 10 hours per week and US-eligible remote work. Compensation is $15 per hour.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on Indonesian generalist evaluation or adjacent content.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.

Responsibilities

  • Evaluate Indonesian generalist evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them for rubric updates.
  • Calibrate reviewer-quality scores against gold-standard examples weekly.
  • Document recurring failure modes for model training.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Indonesian generalist evaluation
AI model evaluation

Job description

AuraOne Human Data is seeking a Bahasa Indonesian AI Evaluation Specialist to remotely assess Indonesian generalist prompts and responses against a quality rubric. You will compare outputs, provide written rationales, and tag edge cases to help retrain and improve our evaluation system.

This independent contractor role requires reliable async availability for at least 10 hours per week and US-eligible remote work. Compensation is $15 per hour.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Analyst (Indonesian Language)
Remote AI Evaluation Analyst (Indonesian Language)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Indonesian AI Evaluation Specialist - Remote Contractor
Indonesian AI Evaluation Specialist - Remote Contractor

Auraone • United States

Remote
USD 69,000 - 83,000
Indonesian AI Evaluation Specialist – Remote Contract
Indonesian AI Evaluation Specialist – Remote Contract

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Remote work
Contractor
Remote Indonesian AI Quality Analyst: Personalization Evaluation
Remote Indonesian AI Quality Analyst: Personalization Evaluation

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Indonesian Evaluation & Annotation Specialist
Remote Indonesian Evaluation & Annotation Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 49,000
Bahasa Indonesian AI Evaluation Specialist
Bahasa Indonesian AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Indonesian AI Quality Analyst, Personalization Evaluation
Indonesian AI Quality Analyst, Personalization Evaluation

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Bahasa Indonesian Business Analyst (AI Evaluation)
Bahasa Indonesian Business Analyst (AI Evaluation)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote Indonesian Psychologist (Bilingual) — Evaluation Specialist
Remote Indonesian Psychologist (Bilingual) — Evaluation Specialist

Auraone • United States

Remote
USD 55,000 - 96,000
Remote Indonesian Language Specialist for AI Training
Remote Indonesian Language Specialist for AI Training

Agency • United States

Remote
USD 8,300 - 90,000