Coding Expert for AI Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 28,000 - 62,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a detail-oriented contractor to help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers. The work focuses on accuracy, clarity, and usefulness in real developer workflows.

You will analyze code across several programming languages, write precise explanations, and provide actionable feedback to improve AI responses. This is a remote, part-time contract role with flexible hours.

Qualifications

• Bachelor's degree in computer science, software engineering, or a related field, or equivalent hands-on software-development experience.
• Careful attention to technical detail.
• Ability to analyze long technical conversations and documentation.
• Ability to work independently in a remote setting.
• Strong written and verbal English communication.

Responsibilities

• Analyze, interpret, and debug code and technical documentation.
• Write clear, technically accurate explanations and annotations for code segments.
• Review and improve AI-generated answers to software-development challenges.
• Read, run, and troubleshoot codebases across several programming languages.
• Compare long-form responses to complex, multi-step coding prompts.
• Document findings and provide actionable feedback.

Skills

Attention to detail

Technical analysis

Independent remote work

English communication

Education

Bachelor's degree in computer science, software engineering, or related field or equivalent hands-on software-development experience

Tools

Annotation tools

Code review tools

Job description

Coding & Software

Remote Hourly · $20–$45/hr

$20–$45/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open in 52 countries

• United States
• Algeria
• Argentina
• Austria
• Bahrain
• Bangladesh
• Belgium
• Brazil
• Canada
• Chile
• Colombia
• Denmark
• Egypt
• France
• Germany
• Ghana
• Greece
• India
• Indonesia
• Italy
• Japan
• Jordan
• Kazakhstan
• Kenya
• Kuwait
• Kyrgyzstan
• Lebanon
• Malaysia
• Mexico
• Morocco
• Netherlands
• Nigeria
• Oman
• Pakistan
• Palestine
• Peru
• Philippines
• Portugal
• Qatar
• Saudi Arabia
• Singapore
• South Africa
• Spain
• Sri Lanka
• Switzerland
• Taiwan
• Thailand
• Tunisia
• United Arab Emirates
• United Kingdom
• United States
• Uzbekistan
• Vietnam

The work

You will help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers. The work focuses on whether solutions are accurate, clear, and useful in real developer workflows.

You will also work with longer technical conversations and varied codebases. Your feedback will help improve future AI responses to complex programming tasks.

• Analyze, interpret, and debug code and technical documentation.
• Write clear, technically accurate explanations and annotations for code segments.
• Review and improve AI-generated answers to software-development challenges.
• Read, run, and troubleshoot codebases across several programming languages.
• Compare long-form responses to complex, multi-step coding prompts.
• Document findings and provide actionable feedback.

What it pays and takes

• Pay: $20 to $45 per hour.
• Work type: Part-time contractor role.
• Language: Strong written and verbal English communication.
• Location: Open to candidates in the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, and Kenya.
• Location: Also open to candidates in Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, Palestine, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, the United States, Uzbekistan, Vietnam, and South Africa.
• Background: A bachelor's degree in computer science, software engineering, or a related field, or equivalent hands-on software-development experience.
• Other requirements: Careful attention to technical detail, the ability to analyze long technical conversations and documentation, and the ability to work independently in a remote setting.
• Helpful experience: Annotation, code review, or technical content creation. Previous AI experience is not required.

About AI training work

AI training work uses human review to help artificial intelligence learn from examples, including code, written answers, and technical conversations. Experienced software practitioners are paid for applying their subject knowledge to judge whether AI outputs are accurate and useful, and OpenTrain helps people find these projects and build a profile for this type of work.

Requirements

Job details

Location

100% remote

• United States
• Algeria
• Argentina
• Austria
• Bahrain
• Bangladesh
• Belgium
• Brazil
• Canada
• Chile
• Colombia
• Denmark
• Egypt
• France
• Germany
• Ghana
• Greece
• India
• Indonesia
• Italy
• Japan
• Jordan
• Kazakhstan
• Kenya
• Kuwait
• Kyrgyzstan
• Lebanon
• Malaysia
• Mexico
• Morocco
• Netherlands
• Nigeria
• Oman
• Pakistan
• Palestine
• Peru
• Philippines
• Portugal
• Qatar
• Saudi Arabia
• Singapore
• South Africa
• Spain
• Sri Lanka
• Switzerland
• Taiwan
• Thailand
• Tunisia
• United Arab Emirates
• United Kingdom
• United States
• Uzbekistan
• Vietnam

Pay

Hourly · $20–$45/hr

Languages

Engagement

Contract, part-time

Coding & Software

Data type

Computer Code Programming

Computer Programming Coding, Evaluation Rating, Text Generation

Build and improve open source software by adding features, fixing complex bugs, refactoring legacy code, and reviewing code. Earn $50 to $100 per hour equivalent, paid per task that meets the project specifications, for under 20 hours per week.

Build and improve open source software by adding features, fixing complex bugs, refactoring legacy code, and reviewing code. Earn $50 to $100 per hour equivalent, paid per task that meets the project specifications.

Evaluate Rust repositories, tests, and bug-fixing tasks to measure how AI coding systems perform. This remote LATAM contract pays $25 per approved task and requires 20+ hours per week.

Evaluate C# open-source repositories and test how well AI models solve real software issues. This remote LATAM contract pays $25 per label and requires 20+ hours each week.

Review AI project tasks, outputs, verifiers, rubrics, and delivery quality as a remote QC Packaging Engineer. The 3-month contractor assignment requires 20 hours per week and English fluency.