Remote AI QA Engineer — Review & Rank AI Code

Outlier

Ciudad de Mendoza

Remote

ARS 42,443,000 - 72,153,000

Full time

45 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Free access to leading LLMs

Flexible work hours

Job summary

Outlier is looking for QA coders to audit AI-generated code and assess model responses, while crafting precise computer science prompts. This remote, freelance role offers pay up to 34 USD per hour plus performance incentives and dedicated project support.

Ideal candidates will hold a CS degree, demonstrate live production coding experience, and communicate clearly in English with strong attention to detail. Flexible hours and rapid onboarding are available.

Qualifications

Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.