Albanian Bilingual Evaluation Specialist (Remote)

AuraOne; United States; À distance; USD 34 000 - 48 000; Plein temps

Résumé du poste

AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining.

You will work as a contractor, reviewing multilingual content, applying rubrics consistently, and providing clear reasoning for each decision. This role supports ongoing frontier model evaluation and requires strong attention to detail and async availability.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Albanian bilingual content.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning citing rubric clauses.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with policy tags.
• Maintain reviewer quality scores and calibrate against gold-standard examples.

Connaissances

Albanian bilingual evaluation

Annotation & labeling

Rubric-based evaluation

Inter-rater calibration

Attention to detail

Outils

Data labeling tools

Description du poste

AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining.

You will work as a contractor, reviewing multilingual content, applying rubrics consistently, and providing clear reasoning for each decision. This role supports ongoing frontier model evaluation and requires strong attention to detail and async availability.