Frontier AI Data Labeling TPM — Build Safe, Scalable Data

Speedrun Talent Network; Menlo Park (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Hippocratic AI seeks a Technical Program Manager to run the data labeling engine behind our frontier healthcare AI. You will oversee audio labeling, clinician-labeled data, and RLHF datasets, collaborating daily with ML researchers, clinicians, and engineers.

You’ll design guidelines, build QC systems, and scale expert raters to support model training and evaluation loops in a fast-moving healthcare-adjacent environment.

Qualifications

• 5+ years in technical program management or data operations in an AI/ML or data-intensive environment (3+ years exceptional candidates)
• 2+ years hands-on with data labeling, annotation, or model evaluation, including writing guidelines and managing quality at scale
• Experience sourcing and managing contractor or expert annotator workforces through marketplaces or labeling vendors
• Working knowledge of how annotation quality affects model training, including RLHF, preference data, and rater calibration
• A strong grasp of quality metrics (IAA, precision/recall, throughput vs. accuracy)
• Track record of owning critical data or eval projects under time pressure with cross-functional teams

Responsibilities

• Run end-to-end labeling and annotation programs, including audio and voice-conversation labeling and RLHF data
• Turn evaluation needs into labeling tasks, rubrics, and success criteria that gate releases
• Build and scale an expert rater workforce through marketplaces and vendors
• Write labeling guidelines and annotation rubrics for high-stakes clinical judgment
• Engineer data quality at scale with gold sets, calibration sessions, and inter-rater tracking
• Track throughput, cost, and quality and manage vendor relations and tooling

Skills

Program management

Data operations

Annotation guidelines

Quality metrics

Vendor management

Ambiguity tolerance

Tools

Label Studio

Scale AI

SageMaker Ground Truth

Job description

Hippocratic AI seeks a Technical Program Manager to run the data labeling engine behind our frontier healthcare AI. You will oversee audio labeling, clinician-labeled data, and RLHF datasets, collaborating daily with ML researchers, clinicians, and engineers.

You’ll design guidelines, build QC systems, and scale expert raters to support model training and evaluation loops in a fast-moving healthcare-adjacent environment.