Remote PDF Annotation and Odia Evaluation Specialist

AuraOne; United States; On-site; USD 15,000 - 21,000; Part time

Job summary

AuraOne is seeking a remote PDF annotation and transcription reviewer (Odia) to evaluate model outputs against a quality rubric. This contractor role focuses on labeling edge cases, writing clear rationales, and providing structured feedback to retrain the model.

You will compare responses, tag errors, calibrate scores against gold standards, and document recurring issues for improvement. Part-time, remote in the US, approx. 10 hours per week, at $13 per hour.

Qualifications

• Prior evaluation, annotation, or human-rater experience in PDF annotation transcription or similar work.
• Clear written reasoning naming the issue and rubric clause applied.
• Attention to detail and ability to flag when a prompt is problematic.

Responsibilities

• Evaluate pdf annotation transcription experts Odia evaluation outputs against a rubric and assign severity tags for assignments.
• Compare paired responses and select the stronger answer with a written rationale.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

PDF Annotation Transscription Experts?

Job description

AuraOne is seeking a remote PDF annotation and transcription reviewer (Odia) to evaluate model outputs against a quality rubric. This contractor role focuses on labeling edge cases, writing clear rationales, and providing structured feedback to retrain the model.

You will compare responses, tag errors, calibrate scores against gold standards, and document recurring issues for improvement. Part-time, remote in the US, approx. 10 hours per week, at $13 per hour.