Software Engineering, Part-Time AI Evaluation - Remote (United States)

OpenTrain AI; United States; Remote; USD 69,000 - 138,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

No commute

Job summary

OpenTrain AI is seeking experienced engineers to build realistic coding tasks and reference solutions for AI coding evaluation. The role is fully remote and you work on tasks with flexible scheduling, contributing to state-of-the-art AI tooling while maintaining your current job.

Engage with frontier AI coding tools, judge AI-driven solutions, and document technical reasoning. This is independent contractor work with flexible hours, around 15–20 hours per week, in the United States.

Qualifications

• Hands-on expertise in Python 3, Java, Rust, Go, C++, or TypeScript.
• Strong understanding of algorithms and data structures.
• Ability to debug complex systems and refactor large codebases.

Responsibilities

• Build reproducible environments and realistic coding tasks for bug fixes, new features and legacy-code improvements
• Analyze defects and performance bottlenecks across varied codebases, then judge whether the AI’s solution handles them correctly
• Implement maintainable reference solutions that improve clarity, efficiency and reliability
• Document your technical reasoning and review other contributors’ code and submissions for accuracy and clarity

Skills

Python 3

Java

Rust

Go

C++

TypeScript

Algorithms

Data Structures

Software Engineering Principles

Job description

• $50–$100 per hour equivalent, paid per accepted task
• About 15–20 hours a week, you choose when

Work on the cutting edge of AI coding evaluation, on your own schedule, and get paid for the engineering expertise you already have.

The AI systems changing how software gets built are trained and tested by real software engineers. The teams building them need engineers who can create realistic coding problems, judge the AI's solutions, write the reference answer a skilled engineer would produce, and explain where the AI's reasoning or code falls short. Your judgment helps shape the next generation of AI models. This is that work, done remotely around your current job.

What you’ll do

• Build reproducible environments and realistic coding tasks for bug fixes, new features and legacy-code improvements
• Analyze defects and performance bottlenecks across varied codebases, then judge whether the AI’s solution handles them correctly
• Implement maintainable reference solutions that improve clarity, efficiency and reliability
• Document your technical reasoning and review other contributors’ code and submissions for accuracy and clarity

Why this is worth your time

• Get paid the equivalent of $50–$100 an hour to build real AI skills, on top of your current job
• Work directly with frontier AI coding tools and see how they are built, tested and improved, experience most software engineers will not have for years
• Build a career edge for what comes next: AI is reshaping software engineering, and the engineers who understand it from the inside will lead that change
• Fully remote and flexible, no fixed shifts, no commute

Who this is for

• Significant hands-on expertise in at least one of Python 3, Java, Rust, Go, C++ or TypeScript
• Strong understanding of algorithms, data structures and software engineering principles, with the ability to debug complex systems, resolve defects, improve performance and refactor large or legacy codebases
• Professional fluency in English and the ability to explain technical concepts and document engineering decisions clearly
• No AI experience needed. You bring the expertise; we bring the training on the tools.

Pay and details

• $50–$100 per hour equivalent; pay is per accepted task, as an independent contractor
• About 15–20 hours a week, you choose when; fully remote, United States

About OpenTrain AI

OpenTrain AI connects experienced professionals with paid, part-time AI training work: shaping and improving the AI systems that companies are building right now.