AI Content Evaluator & Editor - Remote Contractor

YO AI Labs; City of Melbourne; Remote; AUD 65,000 - 90,000; Full time

Job summary

YO AI Labs is seeking experienced Technical Writers / Editors to contribute to a customer project focused on evaluating and improving advanced AI systems. You will assess AI-generated content against specific prompts, compare responses, and help raise the quality, accuracy, and instructional value of model outputs.

You will apply strong writing and editorial judgment, provide clear scores and rationales, document findings, and collaborate asynchronously with project managers and reviewers.

Qualifications

• Native-level English fluency with excellent written communication skills.
• Experience in technical writing, editing, content evaluation, or a related field.
• Strong understanding of clarity, tone, structure, coherence, and instructional content.
• Familiarity with digital content review, annotation, or evaluation platforms.
• Excellent attention to detail and analytical skills.
• Ability to work independently, meet deadlines, and collaborate remotely.
• Experience with AI systems or model evaluation is a plus, but not required.

Responsibilities

• Evaluate and compare AI-generated responses against specific writing prompts.
• Assess clarity, tone, accuracy, coherence, helpfulness, and adherence to instructions.
• Provide clear scores, rationales, and actionable feedback.
• Identify opportunities to improve the quality and instructional value of AI-generated content.
• Apply strong editorial judgment to distinguish subtle differences in writing quality.
• Maintain accuracy and attention to detail when reviewing and documenting findings.
• Collaborate asynchronously with project managers and reviewers.
• Apply advanced written English and critical analysis skills throughout the evaluation process.

Skills

Technical writing

Editing

Critical analysis

Editorial judgment

Attention to detail

Remote collaboration

Independent work

Job description

YO AI Labs is seeking experienced Technical Writers / Editors to contribute to a customer project focused on evaluating and improving advanced AI systems. You will assess AI-generated content against specific prompts, compare responses, and help raise the quality, accuracy, and instructional value of model outputs.

You will apply strong writing and editorial judgment, provide clear scores and rationales, document findings, and collaborate asynchronously with project managers and reviewers.