Polish Evaluation & Labeling Specialist — Remote

AuraOne

Stati Uniti

In loco

USD 55.000 - 83.000

Tempo pieno

14 giorni+

Generatore di candidature

Ricevi una risposta da questo datore di lavoro — un curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Vantaggi offerti da questo lavoro

Remote work

Contractor role

US work eligibility

Descrizione del lavoro

AuraOne is seeking a Polish bilingual expert to remotely review Polish generalist evaluation prompts and responses against our quality rubric, label edge cases, and provide structured feedback for retraining.

In this contractor role, you will compare paired outputs, assign severity tags, document recurring failure modes, and ensure consistency across long review batches, with flexible weekly time commitment.

Competenze

Prior evaluation, annotation, or human-rater experience on polish generalist evaluation or adjacent content.
Ability to apply multi-page rubrics consistently across large batches.
Clear written reasoning that names the issue and the rubric clause being applied.
Reliable async availability for at least 10 hours per week.

Mansioni

Evaluate polish generalist evaluation model outputs against rubric and assign severity tags.
Compare paired responses and pick the stronger answer with a written rationale.
Label hallucinations, instruction-following failures, and unsafe content with structured tags.
Capture ambiguous prompts and route them back to the program team for rubric updates.
Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
Document recurring failure modes so the modeling team can target them in the next training run.