Remote AI QA Coder — Rate, Review & Improve Code

Outlier; Caguas (PR); Remote; USD 39,000 - 55,000; Part time

Benefits offered by this job

Free access to leading LLMs

Work from anywhere

Job summary

Outlier is a remote program seeking experienced software engineers to help train AI models by reviewing AI-generated code. You will flag issues and provide structured feedback to improve model outputs.

As a QA Coder, you will rate responses across accuracy, instruction following, and presentation, and craft clear prompts to challenge AI systems. This is a 1099 contract with flexible hours and remote eligibility for Latin American applicants.

Qualifications

• Bachelor's degree in CS from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions to improve model output.
• Write computer science prompts to challenge AI models and advance coding capabilities.

Skills

Software engineering experience

Live production codebase

English proficiency

Education

Bachelor's degree in Computer Science

Job description

Outlier is a remote program seeking experienced software engineers to help train AI models by reviewing AI-generated code. You will flag issues and provide structured feedback to improve model outputs.

As a QA Coder, you will rate responses across accuracy, instruction following, and presentation, and craft clear prompts to challenge AI systems. This is a 1099 contract with flexible hours and remote eligibility for Latin American applicants.