AI QA Engineer: Review & Improve AI Code (Remote)

Outlier; Buenos Aires; Remote; ARS 42,443,000 - 72,153,000; Full time

Benefits offered by this job

Free access to leading LLMs

Remote work flexibility

Job summary

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses to improve code generation quality. You will craft prompts and contribute to evaluation guidelines, working with engineers across Latin America on a flexible, remote basis.

Ideal candidates hold a Bachelor's in Computer Science with production code experience, strong English communication, and meticulous attention to detail.

Qualifications

• Completed a Bachelor's degree in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English proficiency

Code auditing

Attention to detail

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to review AI-generated code, flag issues, and rate model responses to improve code generation quality. You will craft prompts and contribute to evaluation guidelines, working with engineers across Latin America on a flexible, remote basis.

Ideal candidates hold a Bachelor's in Computer Science with production code experience, strong English communication, and meticulous attention to detail.