Remote ML Engineer - AI Reasoning & Evaluation Trainer

DataAnnotation; O’Fallon (MO); Remote; USD 170,000 - 243,000; Full time

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, including training, evaluation, debugging, and productionizing. You will craft prompts and assess AI outputs to identify subtle errors, then write correct, practitioner-backed solutions that improve model behavior.

The role emphasizes hands-on experience with ML stacks (Python, PyTorch or JAX) and clear written English.

Qualifications

• Hands-on experience training, evaluating, or deploying models.
• Comfort with Python and PyTorch or JAX.
• Clear written English.
• No degree required.

Responsibilities

• Write prompts to probe how models reason about training, evaluation, debugging, and productionizing ML systems.
• Review AI output for subtle errors: leaky evaluations, wrong loss formulations, and misdiagnosed training failures.
• Provide correct solutions grounded in real practitioner experience.

Skills

ML model development

Model evaluation & debugging

Technical writing

English communication

Tools

Python

PyTorch

JAX

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, including training, evaluation, debugging, and productionizing. You will craft prompts and assess AI outputs to identify subtle errors, then write correct, practitioner-backed solutions that improve model behavior.

The role emphasizes hands-on experience with ML stacks (Python, PyTorch or JAX) and clear written English.