Remote Technical Writing Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne is seeking a Technical Writing Specialist for a remote evaluation track. You will review prompts and responses, apply a quality rubric, and provide structured feedback to support retraining of the model.

You will compare outputs, label edge cases, and draft rationales to guide improvements. Responsibilities include evaluating model outputs, tagging issues, and calibrating judgments against gold examples on a contractor basis.

Qualifications

• Prior evaluation, annotation, or human-rater experience in technical writing evaluation or adjacent content.
• Clear written reasoning naming the issue and rubric clause.
• Strong attention to detail and ability to flag when a prompt is the problem.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and escalate rubric updates.
• Maintain reviewer-quality scores by calibration against gold-standard examples.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Technical Writing evaluation

Job description

AuraOne is seeking a Technical Writing Specialist for a remote evaluation track. You will review prompts and responses, apply a quality rubric, and provide structured feedback to support retraining of the model.

You will compare outputs, label edge cases, and draft rationales to guide improvements. Responsibilities include evaluating model outputs, tagging issues, and calibrating judgments against gold examples on a contractor basis.