Lead ML Engineer - Data Quality & RLHF

NewtonX; United States; On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401K match

Paid vacation and holidays

Paid sick days

Parental leave

Office snacks

Job summary

NewtonX is expanding into AI data annotation and RLHF. This role is the technical owner of data quality; you will partner with the Program Lead, translating client goals into concrete technical specs that guide data design and evaluation.

You will be hands-on, shaping task environments and rubric structures for advanced AI workflows. You will validate datasets at the ML level, diagnose data quality issues, and defend technical choices to clients and the ops team.

Qualifications

• 2+ years hands-on RL experience
• Strong Python and model API familiarity
• Ability to translate customer requirements into technical specs

Responsibilities

• Design the task, environment, and rubric structure for agentic workflows
• Own ML-level validation of datasets before delivery
• Assess data quality across training and evaluation pipelines
• Defend data quality decisions to clients and internal teams

Skills

Python

RLHF

SFT

RLVR

Agentic RL

CoT

Model APIs

Data quality

Statistical rigor

Tools

Eval harness

Job description

NewtonX is expanding into AI data annotation and RLHF. This role is the technical owner of data quality; you will partner with the Program Lead, translating client goals into concrete technical specs that guide data design and evaluation.

You will be hands-on, shaping task environments and rubric structures for advanced AI workflows. You will validate datasets at the ML level, diagnose data quality issues, and defend technical choices to clients and the ops team.