ML Systems Auditor & Prompt Engineer - Remote

DataAnnotation; Washington; Remote; USD 170,000 - 243,000; Full time

Benefits offered by this job

Flexible, remote, project-available

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, focusing on training dynamics, evaluation design, data pipelines, and deployment trade-offs. You will write prompts that probe model behavior and review outputs for subtle errors.

You’ll craft correct, actionable solutions based on real practitioner experience. This remote, project-based role offers compensation up to $150+/hr, with earnings scaling with task difficulty and specialization.

Qualifications

• Hands-on experience training, evaluating, or deploying models professionally or in serious personal work.
• Proficient with Python and PyTorch or JAX.
• Excellent written English communication.

Responsibilities

• Write prompts that probe how models reason about training, evaluation, debugging, and productionizing ML systems.
• Review AI output for subtle errors: leaky evaluations, wrong loss formulations, misdiagnosed training failures.
• Write the correct solution when the model falls short, grounded in real practitioner experience.

Skills

Hands-on ML model development

Python & PyTorch or JAX

Clear written English

Education

No degree required

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, focusing on training dynamics, evaluation design, data pipelines, and deployment trade-offs. You will write prompts that probe model behavior and review outputs for subtle errors.

You’ll craft correct, actionable solutions based on real practitioner experience. This remote, project-based role offers compensation up to $150+/hr, with earnings scaling with task difficulty and specialization.