Remote AI Code QA Engineer

Outlier; Metropolitana; Remote; COP 121,921,000 - 173,645,000; Full time

Benefits offered by this job

1099 contract

Remote work LATAM

Competitive hourly pay

Job summary

Outlier invites experienced software engineers to join a remote QA coding program that trains AI models to generate and evaluate code. You'll review AI-produced code, rate responses, and craft robust questions to stretch model capabilities.

This is a flexible, freelance 1099 contract open to Latin America, with competitive hourly pay and performance incentives. Applicants should have a CS degree, production-code experience, and strong written and spoken English.

Qualifications

• Bachelor's degree in Computer Science from a selective institution is required.
• Experience contributing to a live production codebase is preferred.
• Fluent written and spoken English is required.
• Excellent attention to detail, including grammar, punctuation, and style.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions—accuracy, instruction following, and presentation.
• Write computer science questions to develop prompts that challenge AI models.

Skills

English fluency

Attention to detail

Production code experience

Education

Bachelor's degree in Computer Science

Job description

Outlier invites experienced software engineers to join a remote QA coding program that trains AI models to generate and evaluate code. You'll review AI-produced code, rate responses, and craft robust questions to stretch model capabilities.

This is a flexible, freelance 1099 contract open to Latin America, with competitive hourly pay and performance incentives. Applicants should have a CS degree, production-code experience, and strong written and spoken English.