Remote Technical Writing Evaluation Specialist

Auraone

United States

Remote

USD 34,000 - 55,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne is seeking a Technical Writing Specialist for a remote evaluation track. You will review prompts and responses, apply a quality rubric, and provide structured feedback to support retraining of the model.

You will compare outputs, label edge cases, and draft rationales to guide improvements. Responsibilities include evaluating model outputs, tagging issues, and calibrating judgments against gold examples on a contractor basis.

Qualifications

  • Prior evaluation, annotation, or human-rater experience in technical writing evaluation or adjacent content.
  • Clear written reasoning naming the issue and rubric clause.
  • Strong attention to detail and ability to flag when a prompt is the problem.

Responsibilities

  • Evaluate model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and escalate rubric updates.
  • Maintain reviewer-quality scores by calibration against gold-standard examples.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Technical Writing evaluation

Job description

AuraOne is seeking a Technical Writing Specialist for a remote evaluation track. You will review prompts and responses, apply a quality rubric, and provide structured feedback to support retraining of the model.

You will compare outputs, label edge cases, and draft rationales to guide improvements. Responsibilities include evaluating model outputs, tagging issues, and calibrating judgments against gold examples on a contractor basis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Writer – Model Feedback & Calibration
Remote AI Evaluation Writer – Model Feedback & Calibration

Auraone • United States

Remote
USD 34,000 - 55,000
Technical Writing Specialist
Technical Writing Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Senior Journalist Evaluator & Rubric Specialist
Remote Senior Journalist Evaluator & Rubric Specialist

Auraone • United States

Remote
USD 34,000 - 62,000
Remote work
Contractor role
Hourly pay after interview
Remote Evaluation Specialist - Search Generalist
Remote Evaluation Specialist - Search Generalist

AuraOne, Inc. • United States

Remote
USD 41,000 - 55,000
Remote Web Research Evaluator & Rubric Specialist
Remote Web Research Evaluator & Rubric Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote AI Evaluation Rubric Reviewer & Feedback Specialist
Remote AI Evaluation Rubric Reviewer & Feedback Specialist

AuraOne Human Data • United States

Remote
USD 34,000 - 55,000
Remote AI Evaluation Specialist - Python & Software Eng Content
Remote AI Evaluation Specialist - Python & Software Eng Content

AuraOne Human Data • United States

Remote
USD 41,000 - 69,000
Background in linguistics (nice tohave
Inter-rater agreement metrics
Domain subject-matter expertise
AI Evaluation Specialist - Remote (US)
AI Evaluation Specialist - Remote (US)

AuraOne Human Data • United States

Remote
USD 28,000 - 48,000
Remote work (US-eligible)
Independent contractor
Remote Senior Documentation & Annotation Reviewer
Remote Senior Documentation & Annotation Reviewer

AuraOne Human Data • United States

Remote
USD 28,000 - 69,000
Remote AI Writing Data Review Specialist
Remote AI Writing Data Review Specialist

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000