Remote AI Evaluation Specialist — Flexible Hours

Outlier; Auckland; Remote; NZD 27,000 - 44,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded wrong, all from home or while traveling.

The work contributes to improving AI systems in real-world settings. Compensation includes up to $18 USD per hour with additional incentives and free access to leading LLMs.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank outputs.
• Compare AI-generated images and videos and judge which better follows a prompt.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or mismatched audio.
• Write a specific English explanation highlighting what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Ability to explain issues clearly

Decisive when flaws exist

Work independently

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded wrong, all from home or while traveling.

The work contributes to improving AI systems in real-world settings. Compensation includes up to $18 USD per hour with additional incentives and free access to leading LLMs.