Remote AI Code QA Engineer

Outlier; Panama City (FL); Remote; USD 28,000 - 47,000; Full time

Job summary

Outlier invites you to join a fully remote program where engineers help train AI models by reviewing AI-generated code, rating model responses, and crafting challenging CS prompts. You will contribute to real-world AI training tasks while earning competitive hourly pay and incentives.

Ideal candidates have a CS degree, production code experience, and excellent English communication. This 1099 contract role supports applicants from many countries, including several in Latin America.

Qualifications

• Bachelor's degree in Computer Science or higher from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of coding ability.

Skills

Production codebase

English fluency

Attention to detail

Software engineering

Education

Bachelor's degree in Computer Science

Job description

Outlier invites you to join a fully remote program where engineers help train AI models by reviewing AI-generated code, rating model responses, and crafting challenging CS prompts. You will contribute to real-world AI training tasks while earning competitive hourly pay and incentives.

Ideal candidates have a CS degree, production code experience, and excellent English communication. This 1099 contract role supports applicants from many countries, including several in Latin America.