AI-Document QA Specialist for Developer Docs

Mercor; New York (NY); On-site; USD 48,000 - 73,000; Part time

Job summary

Mercor is seeking a concise reviewer to evaluate AI-generated developer-facing writing (CLI help text, error messages, API references) against client briefs and a writing guide. You will read diffs and terminal outputs, flag inaccuracies, and select a sample with a one-line rationale and tags.

A calibration gate will be cleared against a known-answer test set before live data. The role leans on prior experience leading developer documentation and comfort with evaluating AI-generated content.

Qualifications

• Experience evaluating AI-generated writing against task briefs and guides.
• Comfort with CLI help text, error messages, and API references.
• Ability to read terminal outputs and diffs to identify incorrect explanations.

Responsibilities

• Review AI-generated developer-facing content against the client brief and guide.
• Read diffs and terminal outputs to detect incorrect technical explanations.
• Select a preferred sample or flag unsuitable ones, and provide a one-line justification with tags.
• Clear calibration gate by referencing known-answer test set before live data.

Skills

AI writing evaluation

Technical writing

Attention to detail

Documentation review

Education

Bachelor's degree in a relevant field

Tools

Diff tools

CLI tooling

Job description

Mercor is seeking a concise reviewer to evaluate AI-generated developer-facing writing (CLI help text, error messages, API references) against client briefs and a writing guide. You will read diffs and terminal outputs, flag inaccuracies, and select a sample with a one-line rationale and tags.

A calibration gate will be cleared against a known-answer test set before live data. The role leans on prior experience leading developer documentation and comfort with evaluating AI-generated content.