AI QA Engineer: Review & Rate AI Code Remotely

Outlier; Monterrey; Remote; MXN 718,000 - 1,023,000; Full time

Job summary

Outlier is seeking a QA Coder who will audit AI-generated code and provide structured feedback to help improve AI models. You will rate model responses, focusing on accuracy, instruction following, and presentation, and you will craft clear computer science prompts to push coding capabilities.

The role is remote, with flexible hours, and paid on an hourly basis with performance incentives. A Bachelor's in Computer Science and production code experience are preferred.

Qualifications

• Completed a Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase, ideally for a tech company.
• Ability to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code: read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: score responses across key dimensions to help improve model output.
• Write computer science questions: develop clear, well-structured prompts that challenge AI models.

Skills

Software engineering

English proficiency

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder who will audit AI-generated code and provide structured feedback to help improve AI models. You will rate model responses, focusing on accuracy, instruction following, and presentation, and you will craft clear computer science prompts to push coding capabilities.

The role is remote, with flexible hours, and paid on an hourly basis with performance incentives. A Bachelor's in Computer Science and production code experience are preferred.