Remote AI QA Scientist — Review & Rank AI Code

Outlier; Sur; Remote; COP 121,921,000 - 173,645,000; Full time

Benefits offered by this job

Flexible remote work

Job summary

Outlier is hiring QA Coders to help train AI models by reviewing AI-generated code and providing structured feedback. You will rate responses, identify errors, and guide improvements with clear guidelines. Join a freelance, 1099 contract that pays up to $34 per hour, with additional incentives.

You can work from anywhere, as long as you have strong English and a computer science background. Projects vary, and pay considers expertise, location, and project need.

Qualifications

• Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: develop clear, well-structured prompts that challenge AI models and push the boundaries of coding ability.

Skills

Code review

English proficiency

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is hiring QA Coders to help train AI models by reviewing AI-generated code and providing structured feedback. You will rate responses, identify errors, and guide improvements with clear guidelines. Join a freelance, 1099 contract that pays up to $34 per hour, with additional incentives.

You can work from anywhere, as long as you have strong English and a computer science background. Projects vary, and pay considers expertise, location, and project need.