ML Systems Auditor & Prompt Engineer (Remote, Flexible)

DataAnnotation; Tempe (AZ); Remote; USD 124,000 - 207,000; Full time

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, training dynamics, evaluation design, data pipelines, and deployment trade-offs.

You will write prompts to probe training, evaluation, and productionizing ML systems, and review AI outputs for subtle errors. You’ll craft the correct solutions grounded in real practitioner experience.

Qualifications

• Hands-on experience training, evaluating, or deploying models.
• Proficient with Python and ML stack (PyTorch or JAX).
• Clear written English; no degree required.

Responsibilities

• Write prompts that probe model reasoning about ML systems.
• Review AI output for subtle errors and misdiagnosed training failures.
• Provide correct solutions grounded in practitioner experience.

Skills

Python

PyTorch

JAX

Written English

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, training dynamics, evaluation design, data pipelines, and deployment trade-offs.

You will write prompts to probe training, evaluation, and productionizing ML systems, and review AI outputs for subtle errors. You’ll craft the correct solutions grounded in real practitioner experience.