Remote Code Quality Engineer for AI Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 34,000 - 69,000; Part time

Job summary

OpenTrain AI, Inc. seeks a part-time contractor to review AI-generated code used to train and evaluate large language models, across languages and software scenarios.

You will identify defects, help create benchmarks, and offer feedback to improve reference solutions. This role is remote and requires strong written English, with 20+ hours weekly.

Experience across languages, debugging, and cross-language architecture is highly valued for this position.

Qualifications

• Proven ability to review and critique AI-generated code for correctness and security.
• Experience with production software development and modern engineering practices.
• Ability to evaluate multiple language implementations and architectures.

Responsibilities

• Review AI-generated code and software changes for correctness, security, reliability, scalability, readability, and maintainability.
• Debug complex codebases and identify root causes of technical problems.
• Compare implementations and select or create solutions that meet technical requirements.
• Write clear technical feedback and contribute to evaluation criteria and benchmarks.

Skills

Python

JavaScript

TypeScript

C++

Go

Git

Education

Seven years of professional software engineering experience

Tools

Git

Code reviews

APIs

Databases

Job description

OpenTrain AI, Inc. seeks a part-time contractor to review AI-generated code used to train and evaluate large language models, across languages and software scenarios.

You will identify defects, help create benchmarks, and offer feedback to improve reference solutions. This role is remote and requires strong written English, with 20+ hours weekly.

Experience across languages, debugging, and cross-language architecture is highly valued for this position.