Technical Program Manager, Healthcare AI Data Labeling

Hippocratic AI Inc.; Menlo Park (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Hippocratic AI is hiring a Technical Program Manager to run the human-in-the-loop data labeling engine behind our frontier healthcare AI. You’ll oversee audio and text labeling, supervisor data, and RLHF data, partnering with ML researchers and licensed clinicians to feed model training and evaluation loops.

You’ll manage end-to-end labeling programs, build an expert rater workforce, write guidelines, design QC processes, and align vendors with engineering and clinical teams to maintain velocity

Qualifications

• 5+ years in technical program management or data operations in an AI/ML or data-intensive environment.
• 2+ years hands-on with data labeling, annotation, or model evaluation, including writing guidelines and managing quality at scale
• Experience sourcing and managing contractor or expert annotator workforces through marketplaces or labeling vendors
• Working knowledge of how annotation quality affects model training, including RLHF
• A strong grasp of quality metrics (IAA, precision/recall on gold sets, throughput vs. accuracy)
• Track record of owning critical data or eval projects under time pressure, working with ML engineers and applied scientists
• Comfort with ambiguity in a fast-moving, healthcare-adjacent AI environment

Responsibilities

• Run the data pipelines behind our models, including labeling, annotation, and RLHF data; manage scoping, execution, QA, and delivery.
• Turn evals into products by defining rubrics, success criteria, and labeling tasks for model releases.
• Build and scale an expert rater workforce through marketplaces and in-house teams; design qualification tasks and rates.
• Write labeling guidelines and annotation rubrics for high-stakes clinical judgment.
• Engineer data quality with gold sets, calibration sessions, and inter-rater agreement tracking.
• Drive velocity and accountability by managing vendors, SOWs, and cross-team dependencies.

Skills

Technical program mgmt

Data operations

Data labeling

Contractor management

RLHF data pipelines

Quality metrics

Cross-functional work

Healthcare AI

Tools

Label Studio

Scale AI

SageMaker Ground Truth

Job description

Hippocratic AI is hiring a Technical Program Manager to run the human-in-the-loop data labeling engine behind our frontier healthcare AI. You’ll oversee audio and text labeling, supervisor data, and RLHF data, partnering with ML researchers and licensed clinicians to feed model training and evaluation loops.

You’ll manage end-to-end labeling programs, build an expert rater workforce, write guidelines, design QC processes, and align vendors with engineering and clinical teams to maintain velocity