Remote Python QA Engineer for AI Code Review

Outlier; Cartagena de Indias; Remote; COP 121,921,000 - 173,645,000; Full time

Job summary

Outlier is seeking QA Coders to help train AI models by reviewing AI-generated code and assessing it for errors and quality. You will rate model responses on accuracy and instruction-following, and craft clear computer science prompts to push coding capabilities.

Ideal candidates hold a Bachelor's in CS, have production Code experience, and can articulate complex concepts in English. This is a remote, freelance opportunity across international locations with flexible hours.

Qualifications

• Completed a Bachelor's degree in Computer Science or higher from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: read and flag errors, inconsistencies, or quality issues.
• Rate and rank model responses across dimensions—accuracy, instruction following, and presentation.
• Write computer science questions: develop clear, well-structured prompts that challenge AI models.

Skills

English proficiency

QA coding

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking QA Coders to help train AI models by reviewing AI-generated code and assessing it for errors and quality. You will rate model responses on accuracy and instruction-following, and craft clear computer science prompts to push coding capabilities.

Ideal candidates hold a Bachelor's in CS, have production Code experience, and can articulate complex concepts in English. This is a remote, freelance opportunity across international locations with flexible hours.