Remote AI QA Coder: Review, Rate & Improve Code

Outlier

Tijuana

Remote

MXN 718,000 - 1,023,000

Full time

2 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Free access to leading LLMs

Flexible remote work

Incentive payments

Job summary

Outlier is seeking a QA Coder to help train AI models by reviewing AI-generated code, flagging issues, and scoring responses to guide model improvements. You will rate model outputs on accuracy, instruction following, and presentation, and craft clear CS prompts to challenge the systems.

This is a freelance, 1099 contract open to applicants in multiple countries. Projects are flexible, asynchronous, and compensated hourly with performance incentives based on location and expertise; candidates

Qualifications

Completed a Bachelor's degree or higher in Computer Science.
Software engineering experience contributing to a live production codebase.
Ability to articulate complex concepts fluently in written and spoken English.
Excellent attention to detail in grammar, punctuation, and style.

Responsibilities

Review AI-generated code: read code produced by AI models and flag errors, inconsistencies, or quality issues.
Rate and rank model responses across key dimensions - accuracy, instruction following, and presentation.
Write computer science questions: develop clear, well-structured prompts that challenge AI models.