Remote AI QA Engineer — Code Review & Prompt Craft

Outlier; Caracas; Remote; VES 34,287,000 - 48,833,000; Full time

Benefits offered by this job

Flexible work

Remote-friendly

Competitive pay

Job summary

Outlier is seeking a QA Coder to join a distributed team of software engineers across Latin America. You will review AI-generated code, identify errors, and rate model responses to help improve AI quality. You’ll also craft clear CS prompts to push the models further.

A Bachelor’s in CS and production-code experience are required, with strong English communication and meticulous attention to detail. This is a remote, contract role with flexible location.

Qualifications

• Bachelor's degree in Computer Science required.
• Experience contributing to a live production codebase.
• Fluent written and spoken English.
• Excellent attention to detail in grammar, punctuation, and style.

Responsibilities

• Review AI-generated code: read through code produced by AI models and flag errors, inconsistencies, or quality issues.
• Rate and rank model responses: score responses across key dimensions - accuracy, instruction following, and presentation.
• Write computer science questions: develop clear, well-structured prompts that challenge AI models.

Skills

English proficiency

Attention to detail

Software engineering experience

Code review

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to join a distributed team of software engineers across Latin America. You will review AI-generated code, identify errors, and rate model responses to help improve AI quality. You’ll also craft clear CS prompts to push the models further.

A Bachelor’s in CS and production-code experience are required, with strong English communication and meticulous attention to detail. This is a remote, contract role with flexible location.