Remote Retail & Pharmacy Practice Evaluator

AuraOne; United States; On-site; USD 76,000 - 90,000; Full time

Job summary

AuraOne is seeking a Remote Retail and Pharmacy Practice Reviewer to evaluate model outputs against a quality rubric and provide structured feedback. This independent contractor role focuses on labeling, rationale, and regression case generation to support AuraOne Human Data initiatives.

You will compare paired responses, tag edge cases, and document recurring failure modes, with a commitment of about 10 hours per week and eligibility to work from the United States.

Qualifications

• Prior evaluation or annotation experience on retail and pharmacy practice evaluation.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning naming the issue and the rubric clause.
• Strong attention to detail and ability to flag problematic prompts.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.
• Document recurring failure modes for future improvements.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Retail and Pharmacy Practice evaluate

Job description

AuraOne is seeking a Remote Retail and Pharmacy Practice Reviewer to evaluate model outputs against a quality rubric and provide structured feedback. This independent contractor role focuses on labeling, rationale, and regression case generation to support AuraOne Human Data initiatives.

You will compare paired responses, tag edge cases, and document recurring failure modes, with a commitment of about 10 hours per week and eligibility to work from the United States.