Remote Python QA Engineer - AI Code Review

Outlier; Barquisimeto; A distancia; VES 24.447.000 - 41.560.000; Jornada completa

Descripción de la vacante

Outlier seeks QA Coders to audit AI-generated code and rate model responses. This is a freelance 1099 contract with flexible, remote work across eligible Latin American countries.

We value strong English communication, attention to detail, and the ability to craft clear coding questions. Ideal candidates hold a Bachelor’s degree in Computer Science, have production code experience, and can articulate complex topics in writing and speech.

Formación

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsabilidades

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Conocimientos

Written English

Attention to detail

Educación

Bachelor's degree or higher in Computer Science

Descripción del empleo

Outlier seeks QA Coders to audit AI-generated code and rate model responses. This is a freelance 1099 contract with flexible, remote work across eligible Latin American countries.

We value strong English communication, attention to detail, and the ability to craft clear coding questions. Ideal candidates hold a Bachelor’s degree in Computer Science, have production code experience, and can articulate complex topics in writing and speech.