Bengali PDF Annotation & Evaluation Specialist (Remote)

AuraOne; United States; On-site; USD 15,000 - 21,000; Full time

Job summary

AuraOne seeks a Bengali evaluation specialist to review and compare model outputs for fluency and cultural accuracy. You will write concise rationales and flag issues using a standardized rubric.

Role is remote, contractor-based with asynchronous work; requires native Bengali fluency and strong English writing, plus 10+ hours weekly availability. Experience with model evaluation is a plus.

Qualifications

• Native Bengali fluency with strong written English abilities.
• Experience editing, translating, or evaluating Bengali content.
• Ability to apply multi-page rubrics consistently across evaluation batches.
• Clear written reasoning naming issues and applicable standards.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate Bengali model responses for fluency, accuracy, register, and cultural fit.
• Compare paired Bengali outputs and select the stronger with a written rationale.
• Flag hallucinations, code-switching and formality mismatches with severity tags.
• Capture native-speaker edits showing correct phrasing for issues.
• Calibrate against the AuraOne Bengali rubric in weekly reviewer-quality cycles.
• Surface ambiguous prompts to improve rubrics.
• Maintain reviewer notes on tricky idioms and regional usage.

Skills

Bengali fluency

Strong written English

Editing Bengali content

Evaluating Bengali content

Rubric application

Written rationale

Async availability

Model evaluation experience

Tools

TMS tools

MQM taxonomies

Job description

AuraOne seeks a Bengali evaluation specialist to review and compare model outputs for fluency and cultural accuracy. You will write concise rationales and flag issues using a standardized rubric.

Role is remote, contractor-based with asynchronous work; requires native Bengali fluency and strong English writing, plus 10+ hours weekly availability. Experience with model evaluation is a plus.