End-to-End Creative AI Study Lead

Contra; New York (NY); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

401k matching

Company laptop

Equity

Job summary

Contra Labs is a human-centered research lab exploring how creatives use AI and how tools can better serve creative work. We connect a global network of top talent with frontier AI labs and product companies to power benchmarking, evaluation, and post-training efforts.

We are scaling across client engagements and seek a hands-on operator to own projects end to end. You will sit between clients, creative experts, and internal engineering, shipping rigorous, useful results and building scalable,

Qualifications

• Experience designing studies for creative and multimodal workflows.
• Ability to analyze data and translate findings into actionable direction.
• Strong communication skills to explain creative quality and ground truth.

Responsibilities

• Own end-to-end studies from kickoff to readout.
• Develop annotation protocols and evaluation designs.
• Ensure data quality and inter-rater reliability with real-time course corrections.
• Turn analysis into clear findings, reports, and workshops for clients.
• Collaborate with engineering on tooling to speed up processes.

Skills

Study design

Data analysis

Communication

Project management

Qualitative research

Education

Master's or PhD in HCI / cognitive science / psychology / design research

Tools

Annotation tools

QA tooling

Job description

Contra Labs is a human-centered research lab exploring how creatives use AI and how tools can better serve creative work. We connect a global network of top talent with frontier AI labs and product companies to power benchmarking, evaluation, and post-training efforts.

We are scaling across client engagements and seek a hands-on operator to own projects end to end. You will sit between clients, creative experts, and internal engineering, shipping rigorous, useful results and building scalable,