AI Support QA Specialist — Remote & Flexible Hours

Prolific Academic Ltd; United States; Remote; USD 25,000 - 41,000; Full time

Job summary

Prolific is seeking Customer Support Representatives to join our Expert Network to train and evaluate AI models using real service expertise. If you pass a short 10–15 minute test, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate AI models.

Researchers paying up to $30 per hour may request long sessions; you must be prepared to complete paid tasks that require one hour of uninterrupted work, with many shorter opportunities.

Qualifications

• Years of experience in a high-volume customer support, technical support, or client success role.
• Exceptional written English with the ability to adjust tone, empathy, and clarity based on different customer personas.
• Proven ability to de-escalate complex situations and provide step-by-step troubleshooting for technical or billing issues.
• High typing speed and the ability to navigate multiple information sources quickly to find accurate answers.
• A sharp eye for identifying subtle errors in logic, tone, or factual accuracy in support responses.
• Multilingual capabilities are a significant plus, especially for evaluating translation and localized support quality.
• A PayPal account to receive payment from our clients.

Responsibilities

• Evaluate AI chatbot responses for accuracy, brand voice consistency, and "helpfulness" scores.
• Simulate customer interactions by creating realistic support tickets and dialogue flows.
• Refine knowledge bases by auditing AI-generated FAQ articles and macros for clarity and correctness.
• Annotate model responses to identify if the tone is empathetic, professional, or overly robotic.
• Quality assure outputs by comparing them against standard Support QA rubrics to meet service standards.

Skills

High-volume support

Written English

Troubleshooting

Multilingual abilities

PayPal account

Tools

Zendesk

Salesforce Service Cloud

Intercom

Freshdesk

Job description

Prolific is seeking Customer Support Representatives to join our Expert Network to train and evaluate AI models using real service expertise. If you pass a short 10–15 minute test, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate AI models.

Researchers paying up to $30 per hour may request long sessions; you must be prepared to complete paid tasks that require one hour of uninterrupted work, with many shorter opportunities.