AI Evaluation Specialist — English (Remote)

Outlier; Lubbock (TX); Remote; USD 15,000 - 25,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible basis. You will roleplay live conversations, compare media, and explain issues in writing, helping AI systems improve and align with prompts.

Work on your own schedule from home or while traveling, with weekly payments and access to leading LLMs. This role emphasizes accuracy, concise explanations, and clear communication in English.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay/zoom in when something seems off.
• Nice to have: Bachelor's degree or above.
• Comfortable thinking on your feet and talking through realistic situations.
• Experience writing concise, evidence-based reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, including zooming and replaying to spot problems like artifacts or mismatches.
• Rating outputs across dimensions and writing specific explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible basis. You will roleplay live conversations, compare media, and explain issues in writing, helping AI systems improve and align with prompts.

Work on your own schedule from home or while traveling, with weekly payments and access to leading LLMs. This role emphasizes accuracy, concise explanations, and clear communication in English.