Remote AI QA Engineer: Review & Rate Model Code

Outlier; Maracay; Remote; VES 34,287,000 - 48,833,000; Full time

Job summary

Outlier is seeking a QA Coder to help improve AI models by reviewing AI-generated code, flagging issues and scoring responses. This remote role offers flexibility and pays up to $34 per hour, plus incentives.

A Bachelor’s degree in Computer Science and strong English are required. Ideal candidates will have production codebase experience and meticulous attention to detail, with opportunities to work across LATAM.

Qualifications

• Completed a Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions to improve model outputs.
• Write clear, well-structured prompts to challenge AI models and advance coding capabilities.

Skills

Bachelor's in CS

Production codebase

English proficiency

Attention to detail

Education

Bachelor's degree in CS

Job description

Outlier is seeking a QA Coder to help improve AI models by reviewing AI-generated code, flagging issues and scoring responses. This remote role offers flexibility and pays up to $34 per hour, plus incentives.

A Bachelor’s degree in Computer Science and strong English are required. Ideal candidates will have production codebase experience and meticulous attention to detail, with opportunities to work across LATAM.