Remote Bilingual Portuguese AI Evaluator

AuraOne, Inc.; United States; On-site; USD 17,000 - 41,000; Full time

Job summary

AuraOne, Inc. is seeking a Bilingual Portuguese AI Evaluation Specialist to remotely review Portuguese model outputs for fluency, accuracy, and cultural fit. You will compare paired responses, provide concise rationales, and flag issues using task-specific severity tags.

The role emphasizes maintaining native-speaker edits and aligning work with AuraOne's rubric in weekly cycles. Candidates should have strong Portuguese fluency and reliable async availability for at least 10 hours per week.

Qualifications

• Native or near-native Portuguese fluency with strong written-English ability.
• Demonstrable experience editing, translating, or evaluating Portuguese content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Portuguese model responses for fluency, accuracy, register, and cultural fit.
• Compare paired Portuguese evaluations and select the stronger with a 1-2 sentence rationale.
• Flag hallucinations, code-switching, and formality mismatches with severity tags.
• Capture native-speaker edits showing correct phrasing alongside each issue.
• Calibrate against AuraOne Portuguese rubric in weekly reviewer cycles.
• Surface ambiguous prompts back to the program team to sharpen rubric.
• Maintain reviewer notes on idioms, regionalisms, and usage.

Skills

Multilingual evaluation

Native-speaker review

Rubric application

LLM output evaluation

Portuguese evaluation

Job description

AuraOne, Inc. is seeking a Bilingual Portuguese AI Evaluation Specialist to remotely review Portuguese model outputs for fluency, accuracy, and cultural fit. You will compare paired responses, provide concise rationales, and flag issues using task-specific severity tags.

The role emphasizes maintaining native-speaker edits and aligning work with AuraOne's rubric in weekly cycles. Candidates should have strong Portuguese fluency and reliable async availability for at least 10 hours per week.