ML Systems Auditor & Prompt Engineer (Remote)

DataAnnotation; Springfield (MO); Remote; USD 124,000 - 207,000; Full time

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, including training dynamics, evaluation design, data pipelines, and deployment trade-offs. You’ll write prompts, review AI outputs for subtle errors, and draft correct, grounded solutions based on practical experience.

This role emphasizes clear written English and hands-on work with Python and the ML stack (PyTorch or JAX) in a remote, project-based setup.

Qualifications

• Hands-on experience training, evaluating, or deploying models.
• Comfort with Python and PyTorch or JAX.
• Clear written English: explanations as the training signal.
• No degree required; focus on what you can do.

Responsibilities

• Write prompts that probe model reasoning in ML systems.
• Review AI outputs for subtle errors and misconfigurations.
• Write correct, grounded solutions when models fall short.

Skills

Python

ML engineering

Model evaluation

Written English

Education

No degree required

Tools

PyTorch

JAX

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, including training dynamics, evaluation design, data pipelines, and deployment trade-offs. You’ll write prompts, review AI outputs for subtle errors, and draft correct, grounded solutions based on practical experience.

This role emphasizes clear written English and hands-on work with Python and the ML stack (PyTorch or JAX) in a remote, project-based setup.