Table Image QA Specialist — Remote Contractor

AuraOne; United States; On-site; USD 34,440 - 68,880; Full time

Job summary

AuraOne is seeking a remote Table Image Reasoning Dataset QA Specialist to evaluate model outputs against a versioned rubric and provide structured feedback for retraining. You will compare paired responses, assign severity tags, and document edge cases to guide improvements.

As a contractor, you will maintain calibration with gold-standard examples, flag prompts issues, and help build auditable labels, rationales, and regression cases for the modeling team. Strong written reasoning is essential.

Qualifications

• Prior evaluation, annotation, or human-rater experience on table image reasoning dataset QA or related content.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause.
• Strong attention to detail and ability to flag when a prompt is the problem.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate table image reasoning dataset QA outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger one with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.
• Document recurring failure modes for future training runs.

Skills

Attention to detail

Written rationale

Async availability

Job description

AuraOne is seeking a remote Table Image Reasoning Dataset QA Specialist to evaluate model outputs against a versioned rubric and provide structured feedback for retraining. You will compare paired responses, assign severity tags, and document edge cases to guide improvements.

As a contractor, you will maintain calibration with gold-standard examples, flag prompts issues, and help build auditable labels, rationales, and regression cases for the modeling team. Strong written reasoning is essential.