Remote AI QA Engineer - Code Reviewer & Prompts

Outlier; Maracay; Remote; VES 24,447,000 - 41,560,000; Part time

Benefits offered by this job

Remote-friendly

Job summary

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses. You will help improve model outputs by scoring accuracy, following instructions, and presentation.

You will also craft clear, well-structured CS prompts to push AI capabilities. The role requires a Bachelor’s degree in Computer Science, production codebase experience, and fluent English, both written and spoken.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science.
• Software engineering experience contributing to a live production codebase.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Code review

Model evaluation

Prompt writing

English communication

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses. You will help improve model outputs by scoring accuracy, following instructions, and presentation.

You will also craft clear, well-structured CS prompts to push AI capabilities. The role requires a Bachelor’s degree in Computer Science, production codebase experience, and fluent English, both written and spoken.