Remote API QA Engineer for AI Code Review

Outlier; Antofagasta; Remote; CLP 38,488,000 - 54,816,000; Full time

Benefits offered by this job

1099 contract

Freelance opportunity

Remote-friendly

Job summary

Outlier is seeking QA Coders to audit AI-generated code, rate model responses, and craft solid CS prompts. You will review code, assess accuracy and instruction adherence, and contribute to improving AI outputs. A Bachelor’s in CS and production-grade software experience are preferred, with strong written and spoken English.

This is a flexible, freelance 1099 contract opportunity. Rates vary by expertise, location, and project need, with potential incentives and international applicants welcome.

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Code review

Technical communication

Attention to detail

QA/testing

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking QA Coders to audit AI-generated code, rate model responses, and craft solid CS prompts. You will review code, assess accuracy and instruction adherence, and contribute to improving AI outputs. A Bachelor’s in CS and production-grade software experience are preferred, with strong written and spoken English.

This is a flexible, freelance 1099 contract opportunity. Rates vary by expertise, location, and project need, with potential incentives and international applicants welcome.