Remote Constraint Solving Reasoning Reviewer

AuraOne, Inc.; United States; Remote; USD 34,000 - 83,000; Full time

Job summary

AuraOne, Inc. is seeking a Constraint Solving Reasoning Reviewer to remotely evaluate prompts and model responses against a quality rubric. You will compare paired outputs, label edge cases, and document structured feedback for retraining the modeling team.

The role is a remote independent contractor for the US, with compensation discussed after interviews. Strong attention to detail and clear written reasoning are essential for success.

Qualifications

• Experience evaluating constraint solving reasoning evaluation or related content.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names issues and rubric clauses.
• Attention to detail and ability to flag prompt problems.

Responsibilities

• Evaluate constraint solving reasoning outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Calibrate reviewer quality against gold-standard examples weekly.
• Document recurring failure modes for model retraining.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Constraint Solving Reasoning eval

Formal reasoning

Proof review

Quantitative analysis

Constraint solving

Solving

Job description

AuraOne, Inc. is seeking a Constraint Solving Reasoning Reviewer to remotely evaluate prompts and model responses against a quality rubric. You will compare paired outputs, label edge cases, and document structured feedback for retraining the modeling team.

The role is a remote independent contractor for the US, with compensation discussed after interviews. Strong attention to detail and clear written reasoning are essential for success.