Remote ML Reasoning & Evaluation Engineer

DataAnnotation; Dayton (OH); Remote; USD 170,000 - 243,000; Full time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about training, evaluation, and productionizing ML systems. You’ll write prompts, review outputs, and craft correct solutions grounded in real practitioner experience.

Based in the United States with flexible, remote work, this role emphasizes hands-on experience with Python and modern ML stacks (PyTorch or JAX). No formal degree is required, and compensation reflects task complexity, up to $150+ per hour.

Qualifications

• Hands-on experience training, evaluating, or deploying models professionally or in serious personal work.
• Comfort with the modern ML stack; most tasks assume Python and PyTorch or JAX.
• Clear written English: your explanations are the training signal.

Responsibilities

• Write prompts that probe how models reason about training, evaluation, debugging, and productionizing ML systems.
• Review AI output for subtle errors: leaky evaluations, wrong loss formulations, and misdiagnosed training failures.
• Write the correct solution when the model falls short, grounded in real practitioner experience.

Skills

Model evaluation

Python

Written English

Tools

PyTorch

JAX

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about training, evaluation, and productionizing ML systems. You’ll write prompts, review outputs, and craft correct solutions grounded in real practitioner experience.

Based in the United States with flexible, remote work, this role emphasizes hands-on experience with Python and modern ML stacks (PyTorch or JAX). No formal degree is required, and compensation reflects task complexity, up to $150+ per hour.