Remote AI Trainer (SWE): Build & Benchmark Tasks

Xperteez Technology

United States

Remote

USD 55,000 - 110,000

Part time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Himalayas is seeking an AI Trainer (SWE) for a global, fully remote contract. You will leverage software engineering expertise to craft advanced AI-completion tasks, evaluate model outputs, and establish objective evaluation standards.

Flexible schedule, 15+ hours per week. Responsibilities include creating realistic tasks, developing instructions, reproducible environments, reference solutions, tests and graders; evaluating model-generated code for correctness and robustness; identifying issues

Qualifications

  • Paid experience training or evaluating AI systems.
  • Strong Python proficiency.
  • Experience with at least one other programming language (Java/JavaScript/TypeScript/C++ etc.).
  • Solid knowledge of software design, debugging, testing, and version control.

Responsibilities

  • Create challenging software engineering tasks for advanced AI models.
  • Develop task instructions, environments, reference solutions, tests, and graders.
  • Evaluate model-generated code for correctness, robustness, and completeness.
  • Identify issues in implementation, dependencies, and performance.

Skills

Python
Software engineering
Version control
Testing
Debugging
CI/CD
Linux
Java
JavaScript
TypeScript
C++
Go
Rust
C#

Tools

Linux
Docker
CI/CD
Command-line tools

Job description

Himalayas is seeking an AI Trainer (SWE) for a global, fully remote contract. You will leverage software engineering expertise to craft advanced AI-completion tasks, evaluate model outputs, and establish objective evaluation standards.

Flexible schedule, 15+ hours per week. Responsibilities include creating realistic tasks, developing instructions, reproducible environments, reference solutions, tests and graders; evaluating model-generated code for correctness and robustness; identifying issues

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Trainer (SWE), Remote- Contract
AI Trainer (SWE), Remote- Contract

Xperteez Technology • United States

Remote
USD 55,000 - 110,000
AI Trainer (SWE) | Remote - Contract
AI Trainer (SWE) | Remote - Contract

Xperteez Technology • United States

Remote
USD 34,000 - 83,000
AI Trainer (ML Engineering) | Remote - Contract
AI Trainer (ML Engineering) | Remote - Contract

Xperteez Technology • United States

Remote
USD 83,000 - 165,000
Remote AI Trainer for Software Engineers - Flexible Hours
Remote AI Trainer for Software Engineers - Flexible Hours

Frontier AI Lab • United States

Remote
USD 83,000 - 165,000
Remote AI Training Engineer (SWE) - Task Evaluations
Remote AI Training Engineer (SWE) - Task Evaluations

Zekai • United States

Remote
USD 83,000 - 165,000
Remote contract role
Worldwide applicants
Remote AI Hardware & Engineering Trainer
Remote AI Hardware & Engineering Trainer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
AI Trainer (SWE)
AI Trainer (SWE)

Zekai • United States

Remote
USD 83,000 - 165,000
Remote contract role
Worldwide applicants
AI Trainer (SWE)
AI Trainer (SWE)

Frontier AI Lab • United States

Remote
USD 83,000 - 165,000
Remote AI Trainer: Per-Task Pay, Flexible Hours
Remote AI Trainer: Per-Task Pay, Flexible Hours

prolificacademicltd • United States

Remote
USD 28,000 - 34,000
Per-task pay
Fully remote
Remote AI Software Engineer Trainer (Part-Time)
Remote AI Software Engineer Trainer (Part-Time)

Anyone AI • United States

Remote
USD 83,000 - 165,000