Remote ML Systems Scientist — Probing Model Reasoning

DataAnnotation

Newark (NJ)

Remote

USD 124,000 - 207,000

Full time

35 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote-friendly
Flexible project-based work

Job summary

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, training dynamics, evaluation design, data pipelines, and deployment trade-offs.

You’ll write prompts that probe reasoning, review AI outputs for subtle errors, and craft correct solutions grounded in real practitioner experience. This remote-friendly role offers up to $150+ per hour, with strong emphasis on clear written English.

Qualifications

  • Hands-on experience training, evaluating, or deploying models professionally or in serious personal work.
  • Proficiency with Python and ML stacks (PyTorch or JAX).
  • Excellent written English communication.

Responsibilities

  • Write prompts that probe how models reason about training, evaluation, debugging, and productionizing ML systems.
  • Review AI output for subtle errors and misdiagnosed issues.
  • Write the correct solution grounded in real practitioner experience.

Skills

Python
PyTorch
JAX
Clear written English

Job description

DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems, training dynamics, evaluation design, data pipelines, and deployment trade-offs.

You’ll write prompts that probe reasoning, review AI outputs for subtle errors, and craft correct solutions grounded in real practitioner experience. This remote-friendly role offers up to $150+ per hour, with strong emphasis on clear written English.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote ML Systems Engineer: Probe & Improve Reasoning
Remote ML Systems Engineer: Probe & Improve Reasoning

DataAnnotation • Chandler (AZ)

Remote
USD 83,000 - 207,000
Remote work
Remote ML Systems Thinker: Prompt Engineer & Debugger
Remote ML Systems Thinker: Prompt Engineer & Debugger

DataAnnotation • Palo Alto (CA)

Remote
USD 170,000 - 243,000
Remote ML Engineer & AI Trainer: Probe & Improve Reasoning
Remote ML Engineer & AI Trainer: Probe & Improve Reasoning

DataAnnotation • Tennessee

Remote
USD 170,000 - 243,000
Flexible work arrangements
Remote work
Project-based income
Remote ML Engineer & AI Reasoning Trainer
Remote ML Engineer & AI Reasoning Trainer

DataAnnotation • South Carolina

Remote
USD 170,000 - 243,000
Flexible, remote work
Project-based work
Remote ML Reasoning & Evaluation Engineer
Remote ML Reasoning & Evaluation Engineer

DataAnnotation • Dayton (OH)

Remote
USD 170,000 - 243,000
Remote work
Flexible schedule
Remote ML Systems Engineer: Prompting & Evaluation
Remote ML Systems Engineer: Prompting & Evaluation

DataAnnotation • Madison (SD)

Remote
USD 170,000 - 243,000
Remote work
Competitive hourly rate
Project-based earnings potential
Remote ML Engineer & AI Reasoning Specialist
Remote ML Engineer & AI Reasoning Specialist

DataAnnotation • Maine

Remote
USD 170,000 - 243,000
Remote ML Systems Engineer: Prompting & Deployment
Remote ML Systems Engineer: Prompting & Deployment

DataAnnotation • Kansas City (MO)

Remote
USD 170,000 - 243,000
Remote ML Systems Engineer & Prompt Specialist
Remote ML Systems Engineer & Prompt Specialist

DataAnnotation • Lafayette (LA)

Remote
USD 170,000 - 243,000
Flexible, remote work
Remote ML Systems Evaluator & Prompt Engineer
Remote ML Systems Evaluator & Prompt Engineer

DataAnnotation • Mesa (AZ)

Remote
USD 170,000 - 243,000
Remote work
Flexible projects