Creative AI Research Project Lead

Contra; San Francisco (CA); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

401k matching

Company laptop

Recruiting team (20 minutes)

CEO and co-founder (30 minutes)

Technical interview, research and方法s焦

Job summary

Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect originality that gets flattened as everything starts to look the same.

We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what good looks like across design, video, imagery, and beyond.

Qualifications

• 3+ years designing studies, running evaluations, analyzing data, and presenting findings.
• Experience with data labeling, annotation, human-in-the-loop systems, or AI and ML evaluation workflows.
• A track record managing several concurrent projects, including annotation, evaluation, or QA work.
• A real point of view on creative quality and what "good" looks like.

Responsibilities

• Define annotation protocols and evaluation designs.
• Manage delivery: scope, staffing, timelines, client relationship.
• Ensure data quality and inter-rater reliability.
• Turn analysis into findings, reports, and workshops.
• Develop repeatable processes with engineering for tooling.
• Produce case studies and benchmark publications.

Skills

Designing studies

Running evaluations

Data analysis

Presenting findings

Education

Advanced degree (HCI / related)

Tools

Data labeling workflows

Annotation tools

AI/ML evaluation workflows

Job description

Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect originality that gets flattened as everything starts to look the same.

We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what good looks like across design, video, imagery, and beyond.