Remote Python Engineer: AI QA & Code Review

Outlier; Sur; Remote; COP 121,921,000 - 173,645,000; Part time

Job summary

Outlier is hiring QA Coders to audit AI-generated code and provide structured feedback, with flexible remote work across Latin America. You'll help train AI models by evaluating quality and consistency, and contribute to live production-like tasks on real projects.

This freelance opportunity pays up to $34 per hour, plus incentives based on project performance; prior software experience and strong English are required, and applicants from multiple countries including Colombia are welcome.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Review AI-generated code

Rate model responses

Write CS prompts

Written and spoken English

Education

Bachelor's degree in Computer Science

Job description

Outlier is hiring QA Coders to audit AI-generated code and provide structured feedback, with flexible remote work across Latin America. You'll help train AI models by evaluating quality and consistency, and contribute to live production-like tasks on real projects.

This freelance opportunity pays up to $34 per hour, plus incentives based on project performance; prior software experience and strong English are required, and applicants from multiple countries including Colombia are welcome.