Remote ML Task Designer & AI Evaluation Engineer

OpenTrain AI, Inc.

United Arab Emirates

Remote

AED 304,000 - 607,000

Part time

16 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenTrain AI, Inc. is seeking an AI Trainer (ML Engineering) and Task Designer to convert practical ML experience into structured technical tasks.

You will design tasks, prepare reproducible environments and reference solutions, and judge model outputs for correctness and reliability. Responsibilities include building evaluative rubrics, reviewing code and experiments, and ensuring submissions meet rigorous project specifications.

Qualifications

  • Expert-level practical machine learning experience with ability to set objective standards for solutions.
  • Familiarity with constructing reproducible environments, reference solutions, rubrics and graders.
  • Experience reviewing model-generated code and analyses for correctness and reliability.
  • Ability to identify data leakage, validation issues, and training instability.

Responsibilities

  • Create realistic ML engineering tasks for advanced AI systems.
  • Build reproducible environments, reference solutions, rubrics and graders.
  • Review model-generated Python code, experiments and analyses for quality.
  • Identify data leakage, incorrect validation, instability and reproducibility issues.
  • Assess technical submissions against project specifications and quality requirements.

Skills

Python
PyTorch
JAX
TensorFlow
scikit-learn
XGBoost
LightGBM
ML benchmarking

Tools

PyTorch
JAX
TensorFlow
scikit-learn
XGBoost
LightGBM

Job description

OpenTrain AI, Inc. is seeking an AI Trainer (ML Engineering) and Task Designer to convert practical ML experience into structured technical tasks.

You will design tasks, prepare reproducible environments and reference solutions, and judge model outputs for correctness and reliability. Responsibilities include building evaluative rubrics, reviewing code and experiments, and ensuring submissions meet rigorous project specifications.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Trainer (ML Engineering) and Task Designer
AI Trainer (ML Engineering) and Task Designer

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 304,000 - 607,000
Remote Enterprise Operations Specialist for AI Evaluation
Remote Enterprise Operations Specialist for AI Evaluation

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 126,000 - 304,000
Remote Computational Research Task Designer
Remote Computational Research Task Designer

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 417,000 - 594,000
Remote work
Remote Aerospace AI Evaluation Specialist
Remote Aerospace AI Evaluation Specialist

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 430,000 - 936,000
Remote work
Remote Software Engineering Researcher for AI Tasks
Remote Software Engineering Researcher for AI Tasks

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 209,000 - 297,000
Remote HS Teacher - AI Training Content Designer
Remote HS Teacher - AI Training Content Designer

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 238,000 - 319,000
Remote Literary AI Evaluation Specialist
Remote Literary AI Evaluation Specialist

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 253,000 - 506,000
Remote work
Remote Sales & Biz Dev Evaluator (Contract)
Remote Sales & Biz Dev Evaluator (Contract)

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 76,000 - 177,000
Remote Philosophy Expert for AI Evaluation
Remote Philosophy Expert for AI Evaluation

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 253,000 - 506,000
Remote MBSE Engineer (SysML v2) for AI Evaluation
Remote MBSE Engineer (SysML v2) for AI Evaluation

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 278,000 - 607,000
Top locations