Tech Program Manager for Frontier AI Data Labeling

Hippocratic AI Inc.; Menlo Park (CA); On-site; USD 190,000 - 230,000; Full time

Job summary

Hippocratic AI Inc. is seeking a Technical Program Manager to run the human-in-the-loop data labeling engine behind our frontier healthcare AI.

You will own end-to-end labeling programs, including audio and clinical data, and work daily with ML researchers and licensed clinicians. You will turn evaluation needs into concrete labeling tasks, build a scalable expert rater workforce, and write guidelines for high-stakes clinical judgment.

Qualifications

• 5+ years in technical program management or data operations in AI/ML or data-heavy environments.
• 2+ years hands-on data labeling, annotation, or model evaluation, including guidelines and QA at scale.
• Experience sourcing and managing contractor annotator workforces through marketplaces or labeling vendors.
• Knowledge of how annotation quality affects model training, including RLHF data and calibration.
• Strong grasp of quality metrics (IAA, precision/recall, throughput vs. accuracy).
• Proven track record owning data or eval projects under time pressure with ML engineers and applied scientists.
• Comfort with ambiguity in a fast-moving, healthcare-adjacent AI environment.

Responsibilities

• Run the data pipelines behind our models. Own end-to-end delivery of labeling and annotation programs, including audio and voice-conversation labeling, supervised labeling, and preference and RLHF data.
• Turn evals into products. Collaborate with ML and Applied Science to convert evaluation needs into labeling tasks, rubrics, and success criteria.
• Build and scale an expert rater workforce. Source, screen, and onboard clinicians and specialized raters via marketplaces, vendors, and in-house teams.
• Write guidelines that shape model behavior. Create labeling guidelines and annotation rubrics, especially for high-stakes clinical judgment.
• Engineer data quality at scale. Design QC systems with gold sets, calibration sessions, and inter-rater tracking.
• Drive velocity and accountability. Manage vendor relationships, choose labeling/QA tooling, and align teams on dependencies.

Skills

Technical PM

Data operations

AI/ML basics

Data labeling

Vendor management

Quality metrics

Clinician collaboration

Tools

Mercor

Upwork

Toloka

Label Studio

SageMaker Ground Truth

Job description

Hippocratic AI Inc. is seeking a Technical Program Manager to run the human-in-the-loop data labeling engine behind our frontier healthcare AI.

You will own end-to-end labeling programs, including audio and clinical data, and work daily with ML researchers and licensed clinicians. You will turn evaluation needs into concrete labeling tasks, build a scalable expert rater workforce, and write guidelines for high-stakes clinical judgment.