Remote JavaScript AI QA Engineer

Outlier; Bayamón (PR); Remote; USD 28,000 - 47,000; Part time

Benefits offered by this job

Flexible remote work

Free access to leading LLMs

Job summary

Outlier is seeking a QA Coder to review AI-generated code, rate model responses on key dimensions, and write clear CS prompts to push AI coding capabilities. This remote contractor role supports projects across Latin America with flexible hours.

Ideal candidates hold a Bachelor's in Computer Science, have production-code experience, and communicate clearly in English with high attention to detail. This is a 1099 contract opportunity with remote, freelance work.

Qualifications

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions — accuracy, instruction following, and presentation — to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

Code review

Prompt writing

Model evaluation

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to review AI-generated code, rate model responses on key dimensions, and write clear CS prompts to push AI coding capabilities. This remote contractor role supports projects across Latin America with flexible hours.

Ideal candidates hold a Bachelor's in Computer Science, have production-code experience, and communicate clearly in English with high attention to detail. This is a 1099 contract opportunity with remote, freelance work.