GitHub Contributor for AI Code Evaluation

OpenTrain AI; Northern (KY); Hybrid; USD 69,000 - 207,000; Part time

Job summary

OpenTrain AI is seeking expert Senior Software Engineers to create Reinforcement Learning environments that test an AI model's ability to solve software engineering problems. You will build reproducible environments and golden reference solutions for tasks involving code fixes, feature development, refactoring, and performance optimization.

The expected commitment is under 20 hours per week, with a project duration of approximately 1 to 3 months.

Qualifications

• Expert in at least one of Python 3, Java, Rust, Go, C++, or TypeScript.
• Strong algorithms and data structures knowledge.
• Proven ability to debug complex systems and optimize performance.
• Open-source contributions with a GitHub or GitLab profile.

Responsibilities

• Create Reinforcement Learning environments for complex software engineering challenges.
• Develop reproducible environments and golden reference solutions.
• Provide code samples, debugging strategies, and development insights in multiple languages.
• Analyze and resolve complex software defects and performance bottlenecks.
• Refactor and optimize legacy code to improve clarity and efficiency.
• Document technical reasoning, solution approaches, and code decisions.
• Review and validate peer-contributed code and technical submissions.

Skills

Python 3

Java

Rust

Go

C++

TypeScript

Algorithms

Data structures

debugging

Documentation

Tools

GitHub

GitLab

Job description

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build their profiles, and apply in minutes.

This is a contractor opportunity for an expert software engineer who wants to apply practical coding knowledge to the development of next-generation AI systems. Previous AI experience is not required.

About AI Training and Code Evaluation

AI training is the human side of building artificial intelligence. Engineers and other specialists provide examples, evaluations, and feedback that help AI models learn how to reason, solve problems, and produce more useful results.

In this role, your software engineering expertise will help create realistic challenges and high-quality reference solutions for evaluating AI performance on complex coding tasks.

The Role

OpenTrain AI is seeking expert Senior Software Engineers to create Reinforcement Learning environments that test an AI model's ability to solve software engineering problems. You will build reproducible environments and golden reference solutions for tasks involving code fixes, feature development, refactoring, and performance optimization.

The expected commitment is under 20 hours per week, with a project duration of approximately 1 to 3 months. Work is remote, conducted in English, and limited to candidates based in the listed countries.

• Role type: Contractor and part-time
• Expected commitment: Less than 20 hours per week
• Project duration: Approximately 1 to 3 months
• Compensation: $50-$150 per hour, output-based per task
• Work language: English
• Eligible locations: United States, Canada, United Kingdom, Australia, New Zealand, Switzerland, Germany, Mexico, and India

What You'll Do

You will contribute expert-level code, debugging approaches, and technical reasoning that can be used to create reliable AI training and evaluation data. Assignments may span multiple programming languages and diverse codebases.

• Create Reinforcement Learning environments for complex software engineering challenges.
• Develop reproducible environments and golden reference solutions.
• Provide code samples, debugging strategies, and development insights in Python 3, Java, Rust, Go, C++, or TypeScript.
• Analyze and resolve complex software defects and performance bottlenecks.
• Implement robust features with attention to scalability, maintainability, and software engineering best practices.
• Refactor and optimize legacy code to improve clarity, efficiency, and reliability.Document technical reasoning, solution approaches, and code decisions.
• Review and validate peer-contributed code and technical submissions for accuracy and clarity.

Requirements and Preferred Qualifications

This is an expert-level opportunity for candidates with strong hands-on software engineering and code evaluation experience. Applicants must have clear open-source contributions and a profile that demonstrates their work, such as GitHub or GitLab.

• Significant expertise in at least one of Python 3, Java, Rust, Go, C++, or TypeScript.
• Strong understanding of algorithms, data structures, and software engineering principles.
• Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
• Experience refactoring large codebases and modernizing legacy systems.
• A track record of delivering high-impact features from conception through delivery.
• Strong technical documentation and communication skills.
• Software engineering AI training and code evaluation subject matter expertise.
• Native or bilingual English proficiency.
• A clear GitHub or GitLab profile with open-source contributions is required.

Compensation and Start Timeline

Compensation is output-based. Experts are paid per task that meets project specifications, and the time required may vary based on experience and workflow. Minimum submission requirements apply.

OpenTrain AI typically fills roles within 48 hours and is seeking experts who can begin promptly. If selected, you are expected to start your first tasks within 24 to 48 hours after completing onboarding.

• Compensation range: $50-$150 per hour
• Payment structure: Output-based per completed task
• Expected start: Within 24 to 48 hours after onboarding