Remote AI QA Engineer – Code Review & Model Evaluation

Outlier; Valparaíso; Remote; CLP 38,488,000 - 54,816,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Free AI tools access

Job summary

Outlier seeks a QA Coder to audit AI-generated code and rate model responses, flagging errors and quality issues to improve AI outputs. You will review code produced by AI models and contribute to structured guidelines for evaluation.

The ideal candidate holds a Bachelor's in Computer Science, has software engineering experience with a live production codebase, and communicates fluently in English. This is a remote 1099 contract with hourly pay up to $34 and additional incentive data.

Qualifications

• Must have excellent English communication (written and spoken).
• Experience in software engineering with live production code is preferred.
• Strong attention to grammar, punctuation and style guidelines.

Responsibilities

• Review AI-generated code and flag errors or quality issues using guidelines.
• Rate and rank AI model responses across key dimensions (accuracy, instruction following, presentation).
• Write clear, well-structured prompts to challenge AI models and improve coding outcomes.

Skills

English language

Attention to detail

Code review

Quality assurance

Education

Bachelor's degree in Computer Science

Job description

Outlier seeks a QA Coder to audit AI-generated code and rate model responses, flagging errors and quality issues to improve AI outputs. You will review code produced by AI models and contribute to structured guidelines for evaluation.

The ideal candidate holds a Bachelor's in Computer Science, has software engineering experience with a live production codebase, and communicates fluently in English. This is a remote 1099 contract with hourly pay up to $34 and additional incentive data.