Remote AI Evaluation Specialist - Flexible Hours

Scale AI; Alaska; Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Join 900K+ Outlier Experts across 52+?

Job summary

Scale AI presents an opportunity via Outlier for detail-oriented English speakers to review AI-generated media and evaluate model outputs. You will engage in live conversations with AI voice models, rate realism and usefulness, and provide written explanations of judgments, all on your own schedule and remotely from the United States.

As a freelance evaluator, you may review images, videos, and audio outputs, rank them by adherence to prompts, and contribute to ongoing quality assessments.

Qualifications

• Fluent English, with strong written communication.
• Attention to detail and patience to review outputs carefully.
• Ability to work independently and manage your own schedule.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos to assess adherence to prompts.
• Inspect outputs closely to spot issues like distortions, flicker, or misalignment between audio and video.
• Provide written explanations of findings in English with concrete examples.
• Perform image evaluations by selecting the better result between two options based on prompt adherence and quality.
• Rank AI-generated videos against prompts or source clips and provide captions when needed.
• Label and describe actions in first-person video tasks with precise captions.

Skills

Fluent English

Detail oriented

Strong written communication

Independent worker

Education

Bachelor's degree or above

Job description

Scale AI presents an opportunity via Outlier for detail-oriented English speakers to review AI-generated media and evaluate model outputs. You will engage in live conversations with AI voice models, rate realism and usefulness, and provide written explanations of judgments, all on your own schedule and remotely from the United States.

As a freelance evaluator, you may review images, videos, and audio outputs, rank them by adherence to prompts, and contribute to ongoing quality assessments.