AI Evaluation Specialist — Remote, Flexible Hours

Outlier; Chattanooga (TN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible scheduling

Remote work

Free access to leading LLMs

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will engage in live, scenario-based conversations with AI voice models, rank outputs by how well they follow prompts, and provide written explanations of what looked wrong. Remote, flexible hours and weekly payments are offered.

Role focuses on assessing images, videos, and audio for adherence, quality, and realism, contributing to an evaluation loop that helps advance AI systems in real-world settings.

Qualifications

• Fluent English required with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing concise, evidence-based reviews or explanations.
• Comfortable thinking on your feet and deciding when options have flaws.

Responsibilities

• Hold live conversations with AI voice models in English and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely (zoom, replay) to spot problems like distortions, flickering, or audio-video mismatches.
• Provide written explanations detailing what was observed and why a given output differs from the prompt.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under uncertainty

Education

Bachelor’s degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will engage in live, scenario-based conversations with AI voice models, rank outputs by how well they follow prompts, and provide written explanations of what looked wrong. Remote, flexible hours and weekly payments are offered.

Role focuses on assessing images, videos, and audio for adherence, quality, and realism, contributing to an evaluation loop that helps advance AI systems in real-world settings.