AI Response Evaluator — Remote, Flexible Hours

Outlier; Rockville (MD); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Hourly pay up to $18 USD

Remote work from anywhere

Free access to leading LLMs

Weekly payments

Job summary

Outlier is hiring detail-oriented English reviewers to evaluate AI-generated media on a fully remote, flexible schedule. You will participate in live conversations with AI voice models, compare media pairs, and explain what is off, all from home.

Your work contributes to improving AI reasoning and alignment with prompts. Role responsibilities include scoring outputs across adherence, quality, and realism, and delivering written explanations in clear English.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable speaking and reasoning in natural, conversational English.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking soundness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misaligned audio.
• Writing a specific English explanation pointing to what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English reviewers to evaluate AI-generated media on a fully remote, flexible schedule. You will participate in live conversations with AI voice models, compare media pairs, and explain what is off, all from home.

Your work contributes to improving AI reasoning and alignment with prompts. Role responsibilities include scoring outputs across adherence, quality, and realism, and delivering written explanations in clear English.