Remote AI Conversation Evaluator (English, Flexible Hours)

Outlier; Albuquerque (NM); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments (ACH/PayPal/AirTM)

Free access to leading LLMs

Job summary

Outlier seeks detail-oriented evaluators to review AI-generated media and engage in live conversations with AI voice models, scoring exchanges and judging how well outputs follow prompts. You will work remotely on a flexible schedule and explain findings in writing to guide AI improvements.

Ideal candidates are fluent in English, detail-oriented, with a bachelor’s degree or higher preferred, and comfortable thinking on their feet in realistic scenarios.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in on media.
• Bachelor's degree or higher preferred.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking naturalness and usefulness of responses and explaining why.
• Comparing AI-generated images and videos for prompt adherence.
• Inspecting outputs to spot problems like distorted anatomy or mismatched audio.
• Writing concise explanations in English referencing observed details.

Job description

Outlier seeks detail-oriented evaluators to review AI-generated media and engage in live conversations with AI voice models, scoring exchanges and judging how well outputs follow prompts. You will work remotely on a flexible schedule and explain findings in writing to guide AI improvements.

Ideal candidates are fluent in English, detail-oriented, with a bachelor’s degree or higher preferred, and comfortable thinking on their feet in realistic scenarios.