Remote Java QA Engineer for AI Code Review

Outlier; Ponce (PR); Remote; USD 39,000 - 55,000; Part time

Benefits offered by this job

Remote work from anywhere

Incentive bonuses

Job summary

Outlier is hiring QA Coders to review AI-generated code and rate model responses. You will work with flexible hours from anywhere, with pay once the project is completed and incentives based on performance and project demand.

Ideal candidates have a CS degree and demonstrated software engineering experience, with strong English communication and meticulous attention to detail to ensure high-quality results.

Qualifications

• Bachelor’s degree in Computer Science from a selective institution.
• Experience contributing to a live production codebase at a technology company.
• Strong written and spoken English communication.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions to challenge AI models and push the boundaries of coding ability.

Skills

Software engineering experience

English proficiency

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is hiring QA Coders to review AI-generated code and rate model responses. You will work with flexible hours from anywhere, with pay once the project is completed and incentives based on performance and project demand.

Ideal candidates have a CS degree and demonstrated software engineering experience, with strong English communication and meticulous attention to detail to ensure high-quality results.