Remote AI Writing Evaluator

Outlier AI; Remote; GBP 60,000 - 80,000; Part time

Job summary

A technology platform for AI evaluation is seeking a Remote AI Writing Evaluator to create high-quality data and evaluate AI responses. This fully remote freelance role offers flexible hours and requires strong analytical and writing skills. Candidates should have a passion for AI and a background in related fields such as literature or creative writing. Compensation is competitive, with hourly pay and bonuses based on performance.

Benefits

Flexible hours

Weekly payouts

Performance-based bonuses

Qualifications

• Ability to craft thoughtful prompts and evaluate AI responses.
• Clear and structured writing for feedback and explanations.
• Consistency in following guidelines and ensuring quality.

Responsibilities

• Create natural, high-quality data reflecting real user perspectives.
• Review and rank AI-generated responses based on clarity and quality.
• Contribute to various projects based on skills and experience.

Skills

Analytical and Problem-Solving Skills

Strong Written Communication

Care and Precision in Execution

Job description

Remote AI Writing Evaluator

Outlier, Birmingham, £46,523 per year - estimated
Contract
NEWREMOTE

Earn up to $16 USD hourly and work fully remotely and flexibly.

Outlier, a platform owned and operated by Scale AI, is looking for English speakers to contribute their expertise toward training and refining cutting‑edge AI systems. If you're passionate about improving models and excited by the future of AI, this is your opportunity to make a real impact.

What You'll Do

• Work from a real user perspective to create natural, high quality data that reflects how people actually use AI in practice.
• Review, compare, and rank responses generated by large language models, focusing on usefulness, clarity, and reasoning quality.
• Contribute across a range of projects based on your skills, interests, and experience.

What We're Looking For

• Analytical and Problem‑Solving Skills: Ability to craft thoughtful prompts and evaluate nuanced AI responses with sound judgment.
• Strong Written Communication: Clear, structured writing to explain decisions, provide feedback, and articulate why one response is stronger than another.
• Care and Precision in Execution: A consistent ability to follow guidelines, notice subtle differences, and ensure outputs meet defined quality standards.

Nice to Have

• Background in fields such as literature, creative writing, history, philosophy, theology, or similar disciplines.
• Prior experience in writing or editorial roles, such as content strategy, technical writing, or editing.
• Curiosity about AI systems, machine learning, or creative technology tools.

Pay & Logistics

• Base Rate: depending on location: US $16.07, GB £ 13.30, CA $20.50 CAD, AU $26.25 AUD, IE €14.60 EUR, NZ $26.00 NZD
• Bonuses: Additional pay available based on project performance.
• Type: Freelance/1099 contract - not an internship.
• Location: 100% remote
• Schedule: Flexible hours – you choose when and how much to work.
• Payouts: Weekly via our secure platform.

This is a freelance position that is paid on a per‑hour basis. We don't offer internships as this is a freelance role. You also must be authorized to work in your country of residence, and we will not be providing sponsorship since this is a 1099 contract opportunity. However, if you are an international student, you may be able to sign up if you are on a visa. You should contact your tax/immigration advisor with specific questions regarding your circumstances. We are unable to provide any documentation supporting employment at this time. Please be advised that compensation rates may differ for non-US locations.