Head of Delivery, AI Evaluation & Creative Data

Morpheus Talent Solutions; New York (NY); Hybride; USD 200 000 - 250 000; Plein temps

Résumé du poste

Morpheus Talent Solutions is seeking a Head of Delivery, Human Data & Creative AI Evaluation in New York or San Francisco. You will own delivery across client projects, lead a team of Strategic Project Leads, and shape scoping, staffing, reporting and measurement.

You will run complex accounts early on, with direct access to the Head of the Lab, and ensure timely, high-quality delivery across expert evaluation, annotation and benchmarking efforts.

Qualifications

• 5+ years in operationally intensive roles (human data or AI training data companies)
• 2+ years managing people
• Experience running multiple client projects simultaneously
• Working knowledge of annotation quality: rubric design, calibration, inter-rater agreement
• Ability to build a cost model from handling times and rates
• Comfort working directly with research teams at AI labs

Responsabilités

• Lead, hire and coach the Strategic Project Lead team and decide staffing across accounts
• Own on-time, high-quality delivery across expert evaluation, annotation and benchmarking projects
• Build and run a consistent operating cadence with weekly delivery reports and monthly forecasts for every client
• Review handling-time estimates and cost models before they go into proposals
• Write and maintain SOPs for expert onboarding, calibration, quality review and payments
• Track and improve portfolio metrics: quality and rater agreement, on-time delivery, handling time against estimate, margin
• Act as the escalation point for client delivery issues
• Partner with research on methodology and with engineering on tooling

Connaissances

Team leadership

People management

Multi-project delivery

Annotation quality

Cost modeling

Collaboration with AI labs

Description du poste

Morpheus Talent Solutions is seeking a Head of Delivery, Human Data & Creative AI Evaluation in New York or San Francisco. You will own delivery across client projects, lead a team of Strategic Project Leads, and shape scoping, staffing, reporting and measurement.

You will run complex accounts early on, with direct access to the Head of the Lab, and ensure timely, high-quality delivery across expert evaluation, annotation and benchmarking efforts.