Remote AI QA Engineer — Full-Stack Code Reviewer

Outlier; San Juan (PR); Remote; USD 39,000 - 55,000; Full time

Job summary

Outlier is seeking QA Coders to review AI-generated code and rate model responses, contributing to live production codebases. This flexible, remote role pays hourly with performance-based incentives and a 1099 contract structure. Prior software engineering experience and strong English communication are essential.

Ideal candidates have a CS degree or higher and meticulous attention to detail. Applicants from various countries can join, with onboarding conducted online and payments issued per

Qualifications

• Completed a Bachelor's degree in Computer Science or higher.
• Software engineering experience contributing to a live production codebase.
• Able to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code and flag errors or quality issues using guidelines.
• Rate and rank model responses across dimensions like accuracy and instruction following.
• Write clear, well-structured prompts to challenge AI models.

Skills

Codebase experience

English fluency

Attention to detail

Code review

Education

Bachelors in Computer Science

Job description

Outlier is seeking QA Coders to review AI-generated code and rate model responses, contributing to live production codebases. This flexible, remote role pays hourly with performance-based incentives and a 1099 contract structure. Prior software engineering experience and strong English communication are essential.

Ideal candidates have a CS degree or higher and meticulous attention to detail. Applicants from various countries can join, with onboarding conducted online and payments issued per