Remote AI QA Coder: Review & Rank Model Outputs

Outlier; Medellín; Remote; COP 121,921,000 - 173,645,000; Full time

Benefits offered by this job

Incentives via Missions

Remote freelance 1099 contract

Job summary

Outlier seeks a QA Coder to review AI-generated code, score model responses, and craft prompts that challenge AI systems. This remote, freelance role offers hourly pay with incentives and requires strong attention to detail and English fluency.

You will work on real AI training tasks, auditing code samples and providing feedback that improves model performance. This is a 1099 contract opportunity across eligible regions.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Job description

Outlier seeks a QA Coder to review AI-generated code, score model responses, and craft prompts that challenge AI systems. This remote, freelance role offers hourly pay with incentives and requires strong attention to detail and English fluency.

You will work on real AI training tasks, auditing code samples and providing feedback that improves model performance. This is a 1099 contract opportunity across eligible regions.