Remote AI Evaluation Analyst (Indonesian Language)

AuraOne Human Data

United States

Remote

USD 34,000 - 55,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. seeks a Bahasa Indonesian Business Analyst (AI Evaluation) to remotely review Indonesian generalist prompts and model outputs against AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

This contractor role requires strong attention to detail, the ability to apply rubrics across long batches, and clear written reasoning. Remote – US-eligible, with hourly compensation confirmed after interviews.

Qualifications

  • Prior evaluation or annotation experience on Indonesian generalist evaluation.
  • Ability to apply multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and rubric clause being applied.
  • Reliable async availability for at least 10 hours per week.

Responsibilities

  • Evaluate Indonesian model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger one with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content.
  • Capture ambiguous prompts and route to program team for rubric updates.
  • Calibrate reviewer scores against gold-standard examples weekly.
  • Document recurring failure modes for future training.

Skills

Indonesian generalist evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Critical Thinking
Business Analysis

Job description

AuraOne, Inc. seeks a Bahasa Indonesian Business Analyst (AI Evaluation) to remotely review Indonesian generalist prompts and model outputs against AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model.

This contractor role requires strong attention to detail, the ability to apply rubrics across long batches, and clear written reasoning. Remote – US-eligible, with hourly compensation confirmed after interviews.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Indonesian AI Evaluation Specialist
Remote Indonesian AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Indonesian AI Quality Analyst: Personalization Evaluation
Remote Indonesian AI Quality Analyst: Personalization Evaluation

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Indonesian AI Evaluation Specialist - Remote Contractor
Indonesian AI Evaluation Specialist - Remote Contractor

Auraone • United States

Remote
USD 69,000 - 83,000
Indonesian AI Evaluation Specialist – Remote Contract
Indonesian AI Evaluation Specialist – Remote Contract

AuraOne Human Data • United States

Remote
USD 57,000 - 81,000
Remote work
Contractor
Remote Indonesian Evaluation & Annotation Specialist
Remote Indonesian Evaluation & Annotation Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 49,000
Bahasa Indonesian Business Analyst (AI Evaluation)
Bahasa Indonesian Business Analyst (AI Evaluation)

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Indonesian AI Quality Analyst, Personalization Evaluation
Indonesian AI Quality Analyst, Personalization Evaluation

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000
Remote Indonesian Psychologist (Bilingual) — Evaluation Specialist
Remote Indonesian Psychologist (Bilingual) — Evaluation Specialist

Auraone • United States

Remote
USD 55,000 - 96,000
Remote Malay AI Evaluation Analyst
Remote Malay AI Evaluation Analyst

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Bahasa Indonesian AI Evaluation Specialist
Bahasa Indonesian AI Evaluation Specialist

AuraOne Human Data • United States

Remote
USD 17,000 - 24,000