Remote Python Engineer for AI QA & Training

Outlier; Metropolitana; Remote; COP 121,921,000 - 173,645,000; Full time

Benefits offered by this job

Free access to leading LLMs

Job summary

Outlier is seeking a QA Coder to review AI-generated code and assess model responses for accuracy and quality. You will write clear prompts and contribute to improving AI code generation.

The role offers flexible, remote work from anywhere and is paid on an hourly, freelance basis through Outlier. Ideal candidates hold a Bachelor's in Computer Science, have production codebase experience, and communicate fluently in English.

Qualifications

• Bachelor's degree in Computer Science from a selective institution.
• Experience contributing to a live production codebase, preferably for a tech company.
• Fluent written and spoken English.

Responsibilities

• Review AI-generated code and flag errors or quality issues using structured guidelines.
• Rate and rank model responses across dimensions like accuracy and instruction following.
• Write clear, well-structured computer science prompts to challenge AI models.

Skills

Code review

Model evaluation

Question formulation

Education

Bachelor's degree in Computer Science

Job description

Outlier is seeking a QA Coder to review AI-generated code and assess model responses for accuracy and quality. You will write clear prompts and contribute to improving AI code generation.

The role offers flexible, remote work from anywhere and is paid on an hourly, freelance basis through Outlier. Ideal candidates hold a Bachelor's in Computer Science, have production codebase experience, and communicate fluently in English.