Hybrid Creative AI Evaluation Lead

Morpheus Talent Solutions; San Francisco (CA); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Morpheus Talent Solutions is seeking a Strategic Project Lead for Creative AI Evaluation, a full-time role based in San Francisco or New York with hybrid work. You will own projects that connect AI labs, creative toolmakers and client teams, ensuring data-driven studies meet ambitious timelines and quality standards.

You will design evaluation methods, manage staffing and delivery, ensure data quality, and translate findings into actionable recommendations and client-ready readouts.

Qualifications

• 3+ years designing studies, running evaluations and presenting findings.
• Experience with data labeling, annotation, human-in-the-loop systems or AI/ML evaluation workflows.
• Experience managing several concurrent projects, including annotation, evaluation or QA work.
• A strong sense of creative quality and ability to distinguish personal preference from ground truth.
• Ability to turn messy work into clear, measurable processes.
• High ownership, low ego, and bias to action; shipping iterations and delivering results.

Responsibilities

• Design annotation protocols, rubrics and evaluation designs for creative and multimodal outputs.
• Manage scope, evaluator staffing, quality routing, timelines, and the client relationship from kickoff to final readout.
• Ensure data quality, inter-rater reliability and real-time course correction when something feels off.
• Turn analyses into clear findings, recommendations, reports and workshops that clients act on.
• Turn repeated work into clean, measurable processes and partner with engineering on tooling for speed and reliability.
• Develop case studies and benchmark publications that sharpen how the lab is understood in the market.

Skills

Study design

Data labeling

Human-in-the-loop

Project management

Creative quality judgment

Process design

Ownership

Job description

Morpheus Talent Solutions is seeking a Strategic Project Lead for Creative AI Evaluation, a full-time role based in San Francisco or New York with hybrid work. You will own projects that connect AI labs, creative toolmakers and client teams, ensuring data-driven studies meet ambitious timelines and quality standards.

You will design evaluation methods, manage staffing and delivery, ensure data quality, and translate findings into actionable recommendations and client-ready readouts.