PDF Annotation & Transcription Experts - Bengali

AI Trainer Jobs; United States; Remote; USD 15,000 - 21,000; Full time

Job summary

AI Trainer Jobs is hiring Bengali language evaluators to remotely assess model outputs for fluency, accuracy and cultural context. Reviewers provide structured rationale and apply rubrics to guide improvements, working as independent contractors.

Ideal candidates are native or near-native Bengali speakers with strong English, capable of applying rubrics across large evaluation batches, and able to commit at least 10 hours per week.

Qualifications

• Native or near-native Bengali fluency with strong written-English ability.
• Demonstrable experience editing, translating, or evaluating Bengali content.
• Experience applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Responsibilities

• Evaluate Bengali model responses for fluency, accuracy, register, and cultural fit for assignments.
• Compare paired Bengali annotation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.

Skills

Native Bengali fluency

Strong written English ability

Rubric application

LLM evaluation

Bengali annotation

Quality assessment

Tools

TMS tools

MQM taxonomies

LLM rubrics

Job description

PDF Annotation & Transcription Experts - Bengali is a remote Bengali specialist track for evaluating bengali annotation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.

Category: Language, Localization & Culture · Pay: $13 / hr · Location: Remote — US-eligible · Contractor

PDF Annotation & Transcription Experts - Bengali is a remote Bengali specialist track for evaluating bengali annotation outputs against native-speaker standards.

About the role

PDF Annotation & Transcription Experts - Bengali is a remote Bengali specialist track for evaluating bengali annotation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale that the modeling team can act on in the next training cycle.
Multilingual model quality depends on reviewers who can read Bengali the way a native speaker does. AuraOne uses these reviewers to set the bar for tone, formality, and cultural register before a model ever ships to Bengali users.
Review translation and localization work. Dialect and cultural context matter here.

Responsibilities

• Evaluate Bengali model responses for fluency, accuracy, register, and cultural fit for PDF Annotation & Transcription Experts - Bengali assignments.
• Compare paired bengali annotation outputs and pick the stronger response with a written rationale.
• Flag hallucinations, code-switching errors, and formality mismatches with task-specific severity tags.
• Capture native-speaker edits that demonstrate the correct phrasing alongside each issue.

Role details

Track Language evaluation Work model Remote · Independent specialist contractor Compensation $13 / hr Eligible from US

What you should bring

• Native or near-native Bengali fluency with strong written-English ability for PDF Annotation & Transcription Experts - Bengali work.
• Demonstrable experience editing, translating, or evaluating Bengali content.
• Comfort applying multi-page rubrics consistently across long evaluation batches.
• Clear written reasoning that names the issue and the standard being applied.
• Reliable async availability for at least 10 hours per week.
• Prior model-evaluation, annotation, or human-rater experience is a plus.

Example tasks

• Score a pair of Bengali responses to a customer-support prompt and pick the better one with a 1-2 sentence rationale.
• Flag formality mismatches in bengali annotation outputs (T/V usage, honorifics, regional register).
• Rewrite a model's Bengali response so it reads naturally and tag the original error category.
• Audit a 50-row evaluation batch for rubric consistency and surface drift back to the program lead.

Useful experience

• Background in Bengali linguistics, journalism, or translation studies.
• Experience with TMS tools, MQM error taxonomies, or other structured QA frameworks.
• Familiarity with LLM evaluation rubrics and inter-rater agreement workflows.

Compensation and schedule

$13 / hr
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Multilingual evaluation
• Native-speaker review
• Rubric application
• LLM output evaluation
• Bengali annotation