Remote Java Engineer for AI Code QA & Review

Outlier; Puebla de Zaragoza; Remote; MXN 718,000 - 1,023,000; Full time

Benefits offered by this job

LLM access

Flexible hours

Job summary

Outlier is seeking a QA coder to review AI-generated code and rate model responses. You will develop clear prompts and contribute to evaluating code generation quality while working in a flexible, remote environment.

The role involves building structured guidelines, collaborating with engineers, and improving AI models through careful feedback. Prior production code experience and strong English communication are required.

Qualifications

• Bachelor's degree in Computer Science from a selective institution.
• Experience contributing to a live production codebase in software engineering.
• Fluent written and spoken English.

Responsibilities

• Review AI-generated code and flag errors using guidelines.
• Rate and rank model responses across accuracy and instruction following.
• Write clear prompts to challenge AI models.

Skills

Code review

Model evaluation

Prompt writing

English proficiency

Education

Bachelor's degree in Computer Science

Tools

Git

Python

GitHub

Job description

Outlier is seeking a QA coder to review AI-generated code and rate model responses. You will develop clear prompts and contribute to evaluating code generation quality while working in a flexible, remote environment.

The role involves building structured guidelines, collaborating with engineers, and improving AI models through careful feedback. Prior production code experience and strong English communication are required.