Remote AI QA Engineer – Review & Score AI Code

Outlier; Ponce (PR); Remote; USD 39,000 - 55,000; Full time

Benefits offered by this job

Free access to leading LLMs

Job summary

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses to improve AI performance. The role emphasizes strong attention to detail and clear English communication. You will write and refine prompts to push model coding capabilities, contributing to real engineering work on AI projects.

This is a freelance, 1099 opportunity with flexible work from anywhere. Rates vary by expertise and project needs, with pay up to $34/hr USD and additional incentive

Qualifications

• Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Fluent written and spoken English.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions - accuracy, instruction following, and presentation.
• Write clear, well-structured computer science prompts to challenge AI models.

Skills

Code review

QA testing

Prompt writing

English communication

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses to improve AI performance. The role emphasizes strong attention to detail and clear English communication. You will write and refine prompts to push model coding capabilities, contributing to real engineering work on AI projects.

This is a freelance, 1099 opportunity with flexible work from anywhere. Rates vary by expertise and project needs, with pay up to $34/hr USD and additional incentive