A complete application in a minute
Tailored resume and cover letter, ready to send.
Outlier is seeking a QA Coder to audit AI-generated code and provide structured feedback. You will participate in scoring model responses and creating challenging CS prompts to improve AI programming tools.
The role emphasizes clear communication in English, strong attention to detail, and experience with live production codebases. Remote work is supported for this freelance opportunity.
Join software engineers across Latin America doing real engineering work — auditing AI code, with dedicated support and up to 40 hrs/week.
Core project work pays up to $34 USD/hr. On average, contributors earn an additional 7.5% through Missions - Outlier's version of surge pricing. The top quartile boosts their earnings by an average of 11%.
Outlier helps the most innovative companies in the world improve their AI models by providing human feedback. Are you an experienced software engineer who would like to lend your programming expertise to train AI models? Join our team to train AI models to excel in code generation!
Projects typically involve discrete and highly variable problems that require interacting with these models while they learn to program. No prior AI experience is required.
Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.
Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase ideally for a technology company.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.
Currently accepting applicants from:
Share Your Experience & Background
01
Complete the Platform Screening
02
Pass the Technical Assessment
03
Attend Your Onboarding Session
04
What is Outlier? How is it related to Scale AI?
Will I be an Outlier employee?
What do I need to sign up for this opportunity?
What's the expected time commitment for participants?
When and how will I be paid?
Who do I contact with questions as I onboard?
** Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.