Remote AI QA Engineer — Audit & Improve Code

Outlier; Medellín; Remote; COP 121,921,000 - 173,645,000; Full time

Job summary

Outlier is seeking a QA Coder to audit AI-generated code and rate model responses. This remote, freelance role offers flexible hours and works with software engineers across Latin America on the Outlier platform.

Ideal candidates have a Bachelor's in Computer Science, live production code experience, and excellent written and spoken English. You will craft prompts and help improve AI model performance while adhering to strict quality guidelines.

Qualifications

• Software engineering experience contributing to live production codebases.
• Fluent written and spoken English.
• Strong attention to grammar, punctuation and style.

Responsibilities

• Review AI-generated code and flag errors or quality issues using guidelines.
• Rate and rank model responses across accuracy, instruction following, and presentation.
• Write clear computer science prompts to challenge AI models.

Skills

Software engineering experience

English communication

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to audit AI-generated code and rate model responses. This remote, freelance role offers flexible hours and works with software engineers across Latin America on the Outlier platform.

Ideal candidates have a Bachelor's in Computer Science, live production code experience, and excellent written and spoken English. You will craft prompts and help improve AI model performance while adhering to strict quality guidelines.