Remote AI Code QA Specialist

Outlier; Santiago de Querétaro; Remote; MXN 718,000 - 1,023,000; Full time

Job summary

Outlier is building a remote, LatAm-wide program where experienced software engineers help train AI models on code generation. As a QA Coder, you review AI-generated code, flag issues, and rate model responses against clear guidelines.

Applicants should have a CS degree and live production code experience, plus strong written and spoken English and meticulous attention to detail. Rates up to $34/hr USD with performance incentives vary by expertise and location.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English proficiency

Code review

Education

Bachelor's degree in Computer Science

Job description

Outlier is building a remote, LatAm-wide program where experienced software engineers help train AI models on code generation. As a QA Coder, you review AI-generated code, flag issues, and rate model responses against clear guidelines.

Applicants should have a CS degree and live production code experience, plus strong written and spoken English and meticulous attention to detail. Rates up to $34/hr USD with performance incentives vary by expertise and location.