End-to-End Creative AI Project Lead

Contra; San Francisco (CA); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

401k matching

Company laptop on start date

Equity

Job summary

Contra Labs is a human-centered research lab scaling its study design and evaluation work for creative AI. You will own end-to-end projects—from data collection and annotation to evaluation and client readouts—aligning three groups: clients, creatives, and engineers.

You will drive qualitative and quantitative analyses, shape methodologies, and deliver clear, actionable findings. Based in San Francisco, CA, with total comp of $150,000–$200,000 USD plus equity.

Qualifications

• 3+ years designing studies, running evaluations, and presenting findings.
• Experience with data labeling, annotation, human-in-the-loop systems, or AI/ML evaluation workflows.
• A track record managing several concurrent projects, including annotation, evaluation, or QA work.
• A real point of view on creative quality and what "good" looks like.

Responsibilities

• Design studies and run evaluations for creative AI projects.
• Analyze data and translate results into actionable directions for clients and teams.
• Coordinate across client, creative experts, and engineering to ship rigorous outputs.
• Develop benchmarking/reporting materials and present findings to stakeholders.

Skills

Study design

Data analysis

Project management

Communication of findings

Qualitative methods

Quantitative methods

Education

Master's or PhD in HCI / cognitive science / psychology

Job description

Contra Labs is a human-centered research lab scaling its study design and evaluation work for creative AI. You will own end-to-end projects—from data collection and annotation to evaluation and client readouts—aligning three groups: clients, creatives, and engineers.

You will drive qualitative and quantitative analyses, shape methodologies, and deliver clear, actionable findings. Based in San Francisco, CA, with total comp of $150,000–$200,000 USD plus equity.