Remote AI QA Coder — Review & Rate Model Code

Outlier; León; Remote; MXN 718,000 - 1,023,000; Full time

Benefits offered by this job

Free access to leading LLMs

Job summary

Outlier is seeking a QA Coder to help train AI models by reviewing AI-generated code and flagging issues with clear guidelines. You will rate and rank model responses to improve accuracy, instruction following and presentation, and you will write concise, well-structured prompts to challenge the models.

This is a flexible, freelance (1099) opportunity with remote work from anywhere. Prior software engineering experience on live production codebases and strong written and spoken English are

Qualifications

• Completed a Bachelor's degree or higher in Computer Science from a selective institution.
• Software engineering experience contributing to a live production codebase, ideally for a technology company.
• Ability to articulate complex concepts fluently in written and spoken English.
• Excellent attention to detail, including grammar, punctuation, and style guidelines.

Responsibilities

• Review AI-generated code: Read through code produced by AI models and flag errors, inconsistencies, or quality issues using structured guidelines.
• Rate and rank model responses: Score responses across key dimensions - accuracy, instruction following, and presentation - to help improve model output.
• Write computer science questions: Develop clear, well-structured prompts that challenge AI models and push the boundaries of their coding ability.

Skills

English proficiency

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to help train AI models by reviewing AI-generated code and flagging issues with clear guidelines. You will rate and rank model responses to improve accuracy, instruction following and presentation, and you will write concise, well-structured prompts to challenge the models.

This is a flexible, freelance (1099) opportunity with remote work from anywhere. Prior software engineering experience on live production codebases and strong written and spoken English are