AI QA Coder: Review AI Code & Design Prompts (Remote)

Outlier

Concepcion

Remote

CLP 38,488,000 - 54,816,000

Full time

40 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier invites experienced software engineers to join our QA coder team, auditing AI-generated code and rating model responses to improve code generation. Remote-friendly freelance contract. You will review code, craft prompts, and help train AI models on real-world coding tasks.

Strong English, attention to detail, and prior production code experience are essential for success. This is a flexible, freelance opportunity with compensation tied to project scope and performance, offered to

Qualifications

Completed a Bachelor's degree or higher in Computer Science from a selective institution.
Software engineering experience contributing to a live production codebase.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.