Remote AI QA Coder: Review & Rate AI Code

Outlier; Cartagena de Indias; Remote; COP 121,921,000 - 173,645,000; Full time

Job summary

Outlier is seeking a QA coder to review AI-generated code, rate model responses, and create clear prompts. You will join a distributed team across the Americas and earn hourly pay up to $34 USD with performance incentives.

Candidates should hold a Bachelor's in Computer Science, have production code experience, and be fluent in English. We value meticulous attention to detail and clear written and spoken communication. This is a freelance 1099 contract.

Qualifications

• Completed a Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase, ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: score responses across key dimensions to help improve model output.
• Write computer science questions: develop clear, well-structured prompts that challenge AI models and push coding ability.

Skills

Production codebase experience

Attention to detail

English proficiency

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA coder to review AI-generated code, rate model responses, and create clear prompts. You will join a distributed team across the Americas and earn hourly pay up to $34 USD with performance incentives.

Candidates should hold a Bachelor's in Computer Science, have production code experience, and be fluent in English. We value meticulous attention to detail and clear written and spoken communication. This is a freelance 1099 contract.