Remote ML Systems Evaluator & Prompt Engineer

DataAnnotation; Mesa (AZ); Remote; USD 170,000 - 243,000; Full time

Benefits offered by this job

Remote work

Flexible projects

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test model reasoning on ML systems, focusing on writing prompts, evaluating model outputs, and delivering grounded, correct solutions based on real practitioner experience.

You’ll work with Python and the modern ML stack (PyTorch or JAX), communicating findings clearly in English. Remote, flexible project work is common with competitive compensation.

Qualifications

• Hands-on experience training, evaluating, or deploying ML models.
• Proficient with Python and PyTorch or JAX.
• Excellent written English.
• No degree required.

Responsibilities

• Write prompts that probe how models reason about ML systems.
• Review AI output for subtle errors and misdiagnosed training failures.
• Write the correct solution when the model falls short, grounded in practitioner experience.

Skills

Python

PyTorch

JAX

English writing

Tools

PyTorch

JAX

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test model reasoning on ML systems, focusing on writing prompts, evaluating model outputs, and delivering grounded, correct solutions based on real practitioner experience.

You’ll work with Python and the modern ML stack (PyTorch or JAX), communicating findings clearly in English. Remote, flexible project work is common with competitive compensation.