Remote Academic Writing Evaluator

Synthires; California; Remote; USD 124,000 - 193,000; Full time

Benefits offered by this job

Fully remote

Flexible schedule

Contractor engagement

Job summary

Synthires is seeking experienced Educator / Assessor Writers to contribute to a customer project focused on developing and improving advanced AI systems. You will evaluate AI-generated writing, scoring it with rubrics and writing rationales to guide improvements.

Prior AI experience is not required; domain expertise in education, assessment, and content evaluation is prioritized. This engagement is fully remote with flexible scheduling.

Qualifications

• Bachelor’s degree from an accredited US/UK/CA/NZ institution.
• Experience marking or grading written work against rubrics.
• Strong written communication and editing skills.
• Ability to work independently in a remote environment.

Responsibilities

• Evaluate and compare AI-generated responses for clarity, tone, helpfulness, and adherence to instructions.
• Assign analytical quality scores using rubrics and evaluation guidelines.
• Write detailed rationales explaining and supporting each assessment or score.
• Identify fluent but unsupported or comprehensive but impractical responses.
• Detect factual errors, internal inconsistencies, unsupported claims, and reliability issues.
• Document evaluation findings accurately and maintain thorough records of decisions and observations.
• Apply assessment criteria consistently across different content types.
• Collaborate asynchronously with project managers and reviewers on digital platforms.
• Incorporate reviewer feedback and maintain consistent evaluation standards.

Skills

Strong English proficiency

Attention to detail

Critical analysis

Editing skills

Independent remote work

Objective judgment

Education

US/CA/UK/NZ degree

Job description

Synthires is seeking experienced Educator / Assessor Writers to contribute to a customer project focused on developing and improving advanced AI systems. You will evaluate AI-generated writing, scoring it with rubrics and writing rationales to guide improvements.

Prior AI experience is not required; domain expertise in education, assessment, and content evaluation is prioritized. This engagement is fully remote with flexible scheduling.