Pricing & ROI Evaluation Specialist (Remote)

AuraOne; United States; On-site; USD 110,208 - 165,312; Part time

Job summary

AuraOne is seeking a Pricing / ROI / revenue economics Evaluator to review prompts and model outputs, compare paired responses, and provide structured feedback that aligns with AuraOne's quality rubric. This remote contractor role supports ongoing evaluation work and requires clear written reasoning.

As a remote contractor, you will label edge cases, tag severity, and document recurring failures. The role requires strong attention to detail, clear written reasoning, and reliable async

Qualifications

• Clear written reasoning that names the issue and the rubric clause being applied.
• Experience with rubric-based annotation and inter-rater calibration is a plus.

Responsibilities

• Evaluate pricing / roi / revenue economics evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and provide a written rationale.
• Tag hallucinations, instruction-following failures, and unsafe content with structured tags.
• Document ambiguous prompts and route them to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Pricing / ROI / revenue economics

Job description

AuraOne is seeking a Pricing / ROI / revenue economics Evaluator to review prompts and model outputs, compare paired responses, and provide structured feedback that aligns with AuraOne's quality rubric. This remote contractor role supports ongoing evaluation work and requires clear written reasoning.

As a remote contractor, you will label edge cases, tag severity, and document recurring failures. The role requires strong attention to detail, clear written reasoning, and reliable async