AI Code QA Engineer — Remote LatAm

Outlier; Caguas (PR); Remote; USD 39,000 - 55,000; Part time

Benefits offered by this job

Remote work from anywhere

Free access to leading LLMs

Competitive pay up to $34 USD/hr

Incentive bonuses via Missions

Job summary

Outlier in LATAM offers a remote, project-based role for experienced software engineers to train AI models by reviewing and scoring AI-generated code. As a QA Coder, you review code, rate model responses, and craft CS questions; participation is a 1099 contract with flexible schedule, and access to leading LLMs.

Applicants from multiple LATAM countries are invited; payment up to $34/hour plus incentives, English proficiency and detail-orientation required.

Qualifications

• Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Code review

English proficiency

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier in LATAM offers a remote, project-based role for experienced software engineers to train AI models by reviewing and scoring AI-generated code. As a QA Coder, you review code, rate model responses, and craft CS questions; participation is a 1099 contract with flexible schedule, and access to leading LLMs.

Applicants from multiple LATAM countries are invited; payment up to $34/hour plus incentives, English proficiency and detail-orientation required.