Remote Kannada Language Evaluator & Quality Reviewer

AI Trainer Jobs; United States; Remote; USD 34,000 - 62,000; Full time

Job summary

AuraOne is seeking a Kannada Language Expert for a remote evaluation track. Review prompts and model outputs against quality rubrics, provide structured feedback, and help retrain the system. This is a contractor, remote role with US-eligibility and flexible weekly hours.

Responsibilities include comparing responses, labeling issues, and maintaining calibration scores. Ideal candidates have priorKannada evaluation experience, attention to detail, and strong reasoning skills.

Qualifications

• Prior evaluation, annotation, or human-rater experience on kannada language evaluation or adjacent content.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate kannada language evaluation model outputs against a versioned rubric and assign severity tags for Kannada Language Expert assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Kannada language evaluation

Annotation

Inter-rater calibration

Linguistics background

Attention to detail

Async availability

Job description

AuraOne is seeking a Kannada Language Expert for a remote evaluation track. Review prompts and model outputs against quality rubrics, provide structured feedback, and help retrain the system. This is a contractor, remote role with US-eligibility and flexible weekly hours.

Responsibilities include comparing responses, labeling issues, and maintaining calibration scores. Ideal candidates have priorKannada evaluation experience, attention to detail, and strong reasoning skills.