AI QA Coder: Review & Rate AI Code (Remote)

Outlier; United States; Remote; USD 39,000 - 55,000; Full time

Job summary

Outlier seeks a QA Coder to help train AI models by reviewing AI-generated code, flagging issues and guiding improvements. This is a 1099 contract with flexible, remote work and up to 40 hours per week.

Ideal candidates have a Bachelor's in Computer Science and production code experience, plus strong written and spoken English and meticulous attention to detail. Rates start at up to $34/hour, with incentives based on project performance.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Code review accuracy

Written & spoken English

Attention to detail

Education

Bachelor's degree or higher in Computer Science

Job description

Outlier seeks a QA Coder to help train AI models by reviewing AI-generated code, flagging issues and guiding improvements. This is a 1099 contract with flexible, remote work and up to 40 hours per week.

Ideal candidates have a Bachelor's in Computer Science and production code experience, plus strong written and spoken English and meticulous attention to detail. Rates start at up to $34/hour, with incentives based on project performance.