Human-Centered AI Evaluation Scientist

Contra; New York (NY); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Medical, Dental, Vision Benefits

401k Matching

Company laptop provided

Job summary

Contra Labs in New York City seeks a researcher to transform ambiguous client questions into rigorous projects across evaluation, post-training data, benchmarking, and human-centered research.

You will own end-to-end engagements, design studies, run analyses in Python/SQL, and generate client-ready insights, reports, and publications while balancing rigor with startup speed and pragmatism.

Qualifications

• 3–5+ years of research in HCI, AI, ML, or design research.
• Strong qualitative and quantitative research skills with evaluation experience.
• Ability to design and execute rigorous research independently.

Responsibilities

• Translate client questions into research directions, hypotheses and study designs.
• Design human-data collection strategies, evaluation protocols, and experiments.
• Analyze qualitative and quantitative data and synthesize insights into actionable recommendations.
• Own research engagements end-to-end from scoping to delivery.

Skills

Research design & execution

Python/SQL analytics

HCI / UX research

Qual & Quant methods

Written communication

Education

Master’s or PhD in related field

Tools

Python

SQL

Job description

Contra Labs in New York City seeks a researcher to transform ambiguous client questions into rigorous projects across evaluation, post-training data, benchmarking, and human-centered research.

You will own end-to-end engagements, design studies, run analyses in Python/SQL, and generate client-ready insights, reports, and publications while balancing rigor with startup speed and pragmatism.