AI QA Engineer — Remote, Flexible Hours

Outlier

Maracay

Remote

VES 34,287,000 - 48,833,000

Full time

5 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking QA Coders to review AI-generated code and rate model responses, while crafting clear computer science prompts to push model performance. This freelance opportunity pays up to $34 USD per hour and includes additional incentives based on project outcomes.

Applicants from eligible Latin American countries can join the flexible, remote program with dedicated onboarding support. Ideal candidates hold a Bachelor's degree in Computer Science, have software engineering experience with

Qualifications

Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.