Remote AI QA Coder — Review & Rate Code

Outlier; Valencia; Remote; VES 24,447,000 - 41,560,000; Full time

Job summary

Outlier invites engineers to join its AI feedback platform to audit AI-generated code, rate model responses, and craft prompts for improved code generation. This freelance 1099 opportunity offers flexible hours, with up to 40 hours per week and additional incentives based on project performance.

Candidates should hold a Bachelor's degree in Computer Science and have experience contributing to production code. Strong written and spoken English is required, with attention to grammar and detail.

Qualifications

• Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English proficiency

Attention to detail

Code review

Education

Bachelor's degree in Computer Science

Job description

Outlier invites engineers to join its AI feedback platform to audit AI-generated code, rate model responses, and craft prompts for improved code generation. This freelance 1099 opportunity offers flexible hours, with up to 40 hours per week and additional incentives based on project performance.

Candidates should hold a Bachelor's degree in Computer Science and have experience contributing to production code. Strong written and spoken English is required, with attention to grammar and detail.