AI QA Coder: Remote Code Review for Models

Outlier; Caguas (PR); Remote; USD 39,000 - 55,000; Full time

Job summary

Outlier invites you to join a structured remote program where your software engineering skills help train AI models in code generation, debugging, and evaluation. You’ll work on projects that require thoughtful review of AI-produced code and clear guidelines.

As a QA Coder, you review AI-generated code, rate model responses across dimensions like accuracy and instruction following, and craft well-structured prompts to challenge AI.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues.
• Rate and rank model responses across dimensions like accuracy, instruction following, and presentation.
• Write computer science questions to create clear, well-structured prompts that challenge AI models.

Skills

Written English

Spoken English

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier invites you to join a structured remote program where your software engineering skills help train AI models in code generation, debugging, and evaluation. You’ll work on projects that require thoughtful review of AI-produced code and clear guidelines.

As a QA Coder, you review AI-generated code, rate model responses across dimensions like accuracy and instruction following, and craft well-structured prompts to challenge AI.