AI Trainer (SWE)

Frontier AI Lab; United States; A distancia; USD 83.000 - 165.000; A tiempo parcial

Descripción de la vacante

Remotebridge is seeking contractors to design and evaluate advanced AI training tasks. You will create realistic software engineering tasks, craft instructions, and build reproducible environments with reference solutions and tests.

The role focuses on evaluating model-generated code and technical deliverables for quality, robustness, and completeness, while identifying issues in implementation, dependencies, and performance.

Formación

• Paid experience training, evaluating, benchmarking, or improving AI systems.
• Strong practical proficiency with Python.
• Professional experience with at least one additional programming language (e.g., Java, JavaScript, TypeScript, Rust, C++, C#, Go).
• Strong knowledge of software design, debugging, testing, version control, and dependency management.

Responsabilidades

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Conocimientos

Python

Java

JavaScript

TypeScript

C++

Go

Rust

C#

Herramientas

Linux

Docker

CI/CD

Descripción del empleo

Pay: $60–$120/hour equivalent, paid per accepted task

Location: Global, fully remote

Job Type: Contractor

Time Commitment: 15+ hours per week

Schedule: Flexible

What You’ll Work On

• Create realistic software engineering tasks that challenge advanced AI models.
• Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
• Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
• Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Required Qualifications

• Prior paid experience training, evaluating, benchmarking, or improving AI systems.
• Strong practical proficiency with Python.
• Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
• Strong knowledge of software design, debugging, testing, version control, and dependency management.

Public Proof of Skill

• Substantial GitHub or GitLab repositories
• Meaningful open-source contributions
• Maintainer or core-contributor responsibilities
• Codeforces, ICPC, Olympiad, or other programming-competition results
• Public developer tools, libraries, systems, or technical projects
• Technical publications, benchmarks, or engineering write-ups

Preferred Qualifications

• Experience creating AI-training tasks, reference solutions, tests, graders, or benchmark problems.
• Experience reviewing other AI trainers’ technical submissions.
• Codeforces rating of approximately 1900 or higher, or strong results in another programming competition.
• Experience with Linux, Docker, CI/CD, command-line tools, or sandboxed environments.
• Prior experience with long-horizon or agentic coding evaluations.
• Availability to begin immediately.

Compensation

Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements. Task availability and completion time may vary.