Remote API Engineer — AI Model QA & Code Review

Outlier; Sur; Remote; COP 121,921,000 - 173,645,000; Full time

Job summary

Outlier is seeking a QA Coder to help train AI models by auditing AI-generated code and providing structured feedback. You will rate model responses across accuracy and instruction-following, and craft clear computer science prompts to challenge models.

Ideal candidates have a Bachelor's degree in Computer Science, production codebase experience, and exceptional written and spoken English. This is a 1099 contract opportunity with flexible remote work for applicants in eligible regions.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English fluency (written & spoken)

Attention to detail

Code review

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to help train AI models by auditing AI-generated code and providing structured feedback. You will rate model responses across accuracy and instruction-following, and craft clear computer science prompts to challenge models.

Ideal candidates have a Bachelor's degree in Computer Science, production codebase experience, and exceptional written and spoken English. This is a 1099 contract opportunity with flexible remote work for applicants in eligible regions.