Remote AI Training Engineer (SWE) - Task Evaluations

Zekai

United States

Remote

USD 83,000 - 165,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote contract role
Worldwide applicants

Job summary

Zekai is seeking software engineers for a 100% remote, contractor role to help design challenging AI-training tasks and evaluate model-generated code. The position focuses on creating robust evaluation criteria, reference solutions, and reproducible environments for advanced AI systems.

Candidates should have prior paid experience with AI training/evaluation and strong Python skills, plus experience in another major language. Flexible schedule and 15+ hours per week are available.

Qualifications

  • Experience training or evaluating AI systems.
  • Strong Python proficiency.
  • Professional experience with at least one other programming language (Java, JavaScript, TypeScript, Rust, C++, C#, Go).
  • Knowledge of software design, debugging, testing, and dependency management.

Responsibilities

  • Create realistic software engineering tasks for advanced AI models.
  • Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
  • Evaluate model-generated code for correctness, robustness, and completeness.
  • Identify issues in implementation, debugging, dependencies, performance, testing, or reproducibility.

Skills

Python
Java
JavaScript
TypeScript
Rust
C++
C#
Go

Tools

Linux
Docker
CI/CD
Git/Version Control

Job description

Zekai is seeking software engineers for a 100% remote, contractor role to help design challenging AI-training tasks and evaluate model-generated code. The position focuses on creating robust evaluation criteria, reference solutions, and reproducible environments for advanced AI systems.

Candidates should have prior paid experience with AI training/evaluation and strong Python skills, plus experience in another major language. Flexible schedule and 15+ hours per week are available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Training Engineer - Eng Sci (Contract)
Remote AI Training Engineer - Eng Sci (Contract)

Zekai • United States

Remote
USD 83,000 - 165,000
Remote AI Product Evaluator: Training & QA Specialist
Remote AI Product Evaluator: Training & QA Specialist

Confidential • United States

Remote
USD 34,000 - 69,000
Remote AI Training Engineer for Advanced Model Evaluation
Remote AI Training Engineer for Advanced Model Evaluation

Xperteez Technology • United States

Remote
USD 34,000 - 83,000
Remote AI Research Evaluation Specialist (Contract, ~15h/wk)
Remote AI Research Evaluation Specialist (Contract, ~15h/wk)

Confidential • United States

Remote
USD 55,000 - 83,000
Senior AI Trainer – Remote Evaluation & Prompting Expert
Senior AI Trainer – Remote Evaluation & Prompting Expert

confidential • United States

Remote
USD 110,000 - 165,000
Remote Intelligence Analyst: AI Evaluation & Benchmarking
Remote Intelligence Analyst: AI Evaluation & Benchmarking

Confidential • United States

Remote
USD 55,000 - 96,000
Remote AI Research & Code Evaluation Engineer
Remote AI Research & Code Evaluation Engineer

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Remote AI Training Scientist – Physical Sciences
Remote AI Training Scientist – Physical Sciences

Zekai • United States

Remote
USD 83,000 - 165,000
Remote AI Evaluation Specialist — Recent Grad
Remote AI Evaluation Specialist — Recent Grad

Confidential • United States

Remote
USD 48,000 - 69,000
Remote AI Hardware & Engineering Trainer
Remote AI Hardware & Engineering Trainer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000