Remote AI QA Coder — Train & Review AI Code

Outlier

Medellín

Remote

COP 121,921,000 - 173,645,000

Full time

47 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking a QA Coder to review AI-generated code, rate model responses, and craft clear, structured prompts to challenge AI models. This is a freelance, 1099 opportunity open to applicants across Latin America.

Core pay goes up to $34 USD/hr, with additional incentives based on project performance. Ideal candidates hold a Bachelor's in Computer Science, have software engineering experience with production code, and can articulate complex concepts in English with strong attention to

Qualifications

Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase ideally for a technology company.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.