Remote AI QA Coder for Code-Generation Models

Outlier; Perímetro Urbano Barranquilla; Remote; COP 86,931,000 - 147,783,000; Full time

Job summary

Outlier invites engineers with a solid CS background to join a remote QA coder program focused on training AI models for code generation. You will review AI-produced code, rate model responses on key dimensions, and craft high-quality CS questions to challenge AI systems.

The program offers flexible remote work across Latin America, with competitive rates and opportunities to earn additional incentives through Missions. Prior coding experience and strong English communication are essential.

Qualifications

• Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English fluency

Attention to detail

Production codebase

Software engineering

Education

Bachelor's in Computer Science

Job description

Outlier invites engineers with a solid CS background to join a remote QA coder program focused on training AI models for code generation. You will review AI-produced code, rate model responses on key dimensions, and craft high-quality CS questions to challenge AI systems.

The program offers flexible remote work across Latin America, with competitive rates and opportunities to earn additional incentives through Missions. Prior coding experience and strong English communication are essential.