Remote AI QA Coder: Review, Rate & Design Prompts

Outlier; Cartagena de Indias; Remote; COP 121,921,000 - 173,645,000; Full time

Benefits offered by this job

Incentives program

Flexible hours

Job summary

Outlier is seeking QA Coders to review AI-generated code, rate model responses, and craft clear computer science prompts. This remote program invites applicants from across Latin America, including Colombia, to contribute to high-quality AI training data.

You’ll work on discrete coding tasks, provide structured feedback, and help push AI models to generate correct and efficient code. Compensation is competitive with incentives and flexible hours.

Qualifications

• Bachelor's degree in CS from a selective institution.
• Software engineer with experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions—accuracy, instruction following, and presentation.
• Write computer science questions: develop clear prompts that challenge AI models.

Skills

English fluency

Attention to detail

Production codebase experience

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking QA Coders to review AI-generated code, rate model responses, and craft clear computer science prompts. This remote program invites applicants from across Latin America, including Colombia, to contribute to high-quality AI training data.

You’ll work on discrete coding tasks, provide structured feedback, and help push AI models to generate correct and efficient code. Compensation is competitive with incentives and flexible hours.