ML Systems Auditor & Prompt Engineer (Remote)

DataAnnotation; Columbia (SC); Remote; USD 138,000 - 207,000; Full time

Job summary

DataAnnotation is where 1M+ experts train the world’s leading AI models. As a Machine Learning Engineer you’ll stress-test how models reason about ML systems and write the answers a strong practitioner would give, shaping how the next generation handles your field.

You’ll write prompts that probe training, evaluation, debugging, and productionizing ML systems, review AI output for subtle errors, and write the correct solution grounded in real practitioner experience.

Qualifications

• Hands-on experience training, evaluating, or deploying models professionally or in serious personal work.
• Comfort with the modern ML stack; most tasks assume Python and PyTorch or JAX.
• Clear written English: your explanations are the training signal.
• No degree required; we care about what you can do, not where you learned it.

Responsibilities

• Write prompts that probe how models reason about training, evaluation, debugging, and productionizing ML systems.
• Review AI output for subtle errors: leaky evaluations, wrong loss formulations, and misdiagnosed training failures.
• Write the correct solution when the model falls short, grounded in real practitioner experience.

Skills

ML experience

Python

PyTorch

JAX

Written English

Job description

DataAnnotation is where 1M+ experts train the world’s leading AI models. As a Machine Learning Engineer you’ll stress-test how models reason about ML systems and write the answers a strong practitioner would give, shaping how the next generation handles your field.

You’ll write prompts that probe training, evaluation, debugging, and productionizing ML systems, review AI output for subtle errors, and write the correct solution grounded in real practitioner experience.