AI Support Quality Analyst — Remote & Flexible

prolificacademicltd; United States; Remote; USD 34,000 - 49,000; Full time

Job summary

Prolific Academic Ltd in the United States is seeking a detail-oriented reviewer to judge AI-written support replies for accuracy, clarity, and tone. The role involves testing scenarios, reviewing help content, and ensuring consistency with professional service standards.

You will create realistic test cases, label sentiment and empathy, and compare model outputs against quality standards. A brief skills assessment is required before joining the paid task pool; remote, flexible hours, and pay

Qualifications

• Experience in a high-volume customer support, technical support, or client success role.
• Strong written English, with the ability to adjust clarity and empathy for different customer situations.
• Skill in calming difficult interactions and explaining technical or billing troubleshooting step by step.
• Fast, accurate typing and the ability to find answers across multiple information sources.
• Careful attention to factual accuracy, logic, and tone.

Responsibilities

• Judge AI-written support replies for accuracy, clarity, helpfulness, and consistency of tone.
• Create realistic support scenarios, including difficult, unusual, or technically complex customer cases.
• Review generated help articles and response templates for correctness and ease of use.
• Label the sentiment and empathy of responses, noting when language sounds unprofessional or robotic.
• Compare model outputs with support quality standards and identify subtle factual or logical errors.

Skills

Customer support experience

Strong written English

Empathy and tone adjustment

Troubleshooting technical/billing

Fast typing

Attention to factual accuracy

High-volume task handling

Tools

Zendesk

Salesforce Service Cloud

Intercom

Freshdesk

Job description

Prolific Academic Ltd in the United States is seeking a detail-oriented reviewer to judge AI-written support replies for accuracy, clarity, and tone. The role involves testing scenarios, reviewing help content, and ensuring consistency with professional service standards.

You will create realistic test cases, label sentiment and empathy, and compare model outputs against quality standards. A brief skills assessment is required before joining the paid task pool; remote, flexible hours, and pay