Remote AI Response Evaluator — Flexible Hours

Outlier; Wilmington (DE); A distancia; USD 17.000 - 25.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Earn up to $18/hr

Flexible hours

Free access to leading LLMs

Missions incentive bonuses

Descripción de la vacante

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images/videos to the prompts, and explain in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your feedback helps shape how advanced AI systems reason and improve. You’ll review outputs, rate adherence, quality, and realism, and contribute to the evaluation loop that guides frontier

Formación

• Fluent English with clear written communication and comfortable with natural conversational speech.
• Strong attention to detail, with the patience to look and listen closely and replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor’s degree or above.
• Able to think on your feet and discuss realistic situations clearly.

Responsabilidades

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely (zooming in, replaying) to spot issues like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatch.
• Rating outputs across dimensions and writing a clear, English-language explanation of what was observed.

Conocimientos

Fluent English

Attention to detail

Adaptability

Writing reviews

Decision making

Educación

Bachelor's degree or above

Descripción del empleo

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images/videos to the prompts, and explain in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your feedback helps shape how advanced AI systems reason and improve. You’ll review outputs, rate adherence, quality, and realism, and contribute to the evaluation loop that guides frontier