Remote AI Code Auditor & QA Engineer

Outlier; Carolina (PR); Remote; USD 28,000 - 47,000; Part time

Job summary

Outlier is seeking a QA Coder to help train AI models by reviewing AI-generated code, flagging errors, and scoring responses. This is a freelance 1099 contract with flexible, remote work and up to 40 hours per week.

You should have a Bachelor's in Computer Science, live production code experience, and strong written and spoken English. Rates start at $34/hr with bonus incentives based on project performance.

Qualifications

• Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail in grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Review AI-generated code

Rate model responses

Write CS questions

Education

Bachelor's degree or higher in Computer Science

Job description

Outlier is seeking a QA Coder to help train AI models by reviewing AI-generated code, flagging errors, and scoring responses. This is a freelance 1099 contract with flexible, remote work and up to 40 hours per week.

You should have a Bachelor's in Computer Science, live production code experience, and strong written and spoken English. Rates start at $34/hr with bonus incentives based on project performance.