ML Systems Engineer: Prompting & Evaluation (Remote)

DataAnnotation; Baton Rouge (LA); Remote; USD 138,000 - 207,000; Full time

Job summary

DataAnnotation is where 1M+ experts train the world’s leading AI models. Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.

As a Machine Learning Engineer you’ll stress-test how models reason about ML systems and write the answers a strong practitioner would give, shaping how the next generation handles your field. Additionally, you’ll collaborate with teams to ensure robust evaluation and deployment

Qualifications

• Hands-on experience training, evaluating, or deploying models professionally or in serious personal work.
• Comfort with the modern ML stack; most tasks assume Python and PyTorch or JAX.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Responsibilities

• Write prompts that probe how models reason about training, evaluation, debugging, and productionizing ML systems.
• Review AI output for subtle errors: leaky evaluations, wrong loss formulations, and misdiagnosed training failures.
• Write the correct solution when the model falls short, grounded in real practitioner experience.

Skills

ML model training

Model evaluation

Model deployment

Python

PyTorch

JAX

Clear written English

Tools

Python

PyTorch

JAX

ML tooling

Job description

DataAnnotation is where 1M+ experts train the world’s leading AI models. Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.

As a Machine Learning Engineer you’ll stress-test how models reason about ML systems and write the answers a strong practitioner would give, shaping how the next generation handles your field. Additionally, you’ll collaborate with teams to ensure robust evaluation and deployment