Remote Java QA Engineer for AI Code Review

Outlier

Caracas

Remote

VES 34,287,000 - 48,833,000

Full time

6 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking a QA Coder to join its distributed Latin America engineering effort, auditing AI-generated code and flagging issues with structured guidelines. You review code created by AI models and rate responses to help improve model performance.

This freelance opportunity pays up to $34 USD/hr, with additional incentives based on project scope and location. Remote work from eligible countries is supported, with onboarding including screening, assessment, and steps.

Qualifications

Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase ideally for a technology company.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.