Remote AI QA Coder - Review & Train Code Models

Outlier; Ponce (PR); Remote; USD 39,000 - 55,000; Full time

Benefits offered by this job

Access to leading LLMs

Job summary

Outlier invites experienced software engineers to join a remote QA coder program that trains AI models to excel in code generation. You will review AI-produced code, score model responses, and craft well-structured CS questions to challenge the AI.

Positions are freelancer-based (1099) with pay up to $34 USD/hr plus incentives. Open to applicants from multiple LATAM countries and flexible work from anywhere. Strong English needed and production code experience is preferred.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Language fluency in English

Software engineering experience

Education

Bachelor's degree in Computer Science

Tools

Live production codebase

Job description

Outlier invites experienced software engineers to join a remote QA coder program that trains AI models to excel in code generation. You will review AI-produced code, score model responses, and craft well-structured CS questions to challenge the AI.

Positions are freelancer-based (1099) with pay up to $34 USD/hr plus incentives. Open to applicants from multiple LATAM countries and flexible work from anywhere. Strong English needed and production code experience is preferred.