Senior Staff Quantitative Product Researcher

Jobtailor; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Jobtailor seeks a senior quantitative researcher to lead metric development and measurement strategy for San Francisco product teams. You will define constructs, design and validate surveys, test reliability, plan experiments, and build behavioral proxy models.

You will collaborate with Data Science and Engineering to steward models, inform retraining, and assess generalizability across user segments. A PhD is preferred, with strong communication to senior leadership.

Qualifications

• PhD in a quantitative field or equivalent practical experience.
• 7+ years of quantitative user research with large-scale data.
• Expertise in survey methodology, reliability and validity testing.
• Experience informing ML model evaluation, retraining triggers, and generalizability.
• Fluency in R or Python and SQL.

Responsibilities

• Lead end-to-end development of user-centered metrics: construct definition, survey design/validation, reliability and sensitivity testing, and experiments.
• Extend measurement work into model stewardship, informing retraining decisions and testing generalizability across user segments.
• Conduct deep-dive learning analyses to identify drivers behind key metrics.
• Translate analyses into actionable direction for product and Data Science partners.
• Set and execute the learning agenda across a broad problem space.
• Partner with Data Science and Engineering to shape measurement work.
• Synthesize analyses and findings to inform product and business decisions.
• Present findings to senior leadership.
• Mentor junior researchers and set quantitative research direction.

Skills

Quantitative User Research

Statistical Modeling

Survey Methodology

R or Python

SQL

Data Visualization

Experimentation

Cross-functional Collaboration

Mentoring

Education

PhD in Computational Social Science

PhD in Statistics

PhD in Computer Science

Tools

AI Tools

Data Visualization Tools

Job description

• Lead the end-to-end development of user-centered metrics, including construct definition, survey design and validation, reliability and sensitivity testing, experimentation planning, and behavioral proxy or predictive model development
• Extend measurement work into model stewardship by informing retraining decisions, evaluating generalizability across user segments, and stress-testing model limitations
• Conduct deep-dive learning analyses to identify drivers and levers behind key metrics
• Translate analyses into actionable direction for product and Data Science partners
• Set and execute the learning agenda across a broad problem space
• Partner as an equal with Data Science and Engineering to shape measurement work
• Synthesize behavioral analyses, experiment results, qualitative insights, and research findings to inform product and business decisions
• Present findings to senior leadership
• Partner with research managers to set quantitative research direction and mentor junior quantitative researchers

Requirements

• 7+ years of quantitative user research experience with large-scale consumer data
• Track record leading metric development end-to-end, from construct definition through survey validation, experimental validation, and behavioral proxy or predictive modeling
• Deep expertise in survey methodology, including construct validity, reliability, and sensitivity
• Expertise in statistical modeling, experimentation at scale, and behavioral analysis
• Experience informing ML model evaluation and maintenance, including retraining triggers, segment generalizability, and failure modes
• Fluency in R or Python and SQL
• Strong data visualization skills
• Ability to operate as a peer to Data Science and Engineering and guide technical work direction
• Experience working horizontally across teams, developing strategy with cross-functional partners, and presenting to senior leadership
• Experience leveraging AI tools in the research process with discernment and a high quality bar
• PhD in a computational social science, statistics, computer science, or related field preferred, or equivalent practical experience

Demonstrates extensive expertise in quantitative user research, statistical modeling, and survey methodology, with a strong ability to translate complex analyses into actionable insights for product and business decisions. Proficient in collaborating with cross-functional teams, including Data Science and Engineering, to drive measurement strategies and mentor junior researchers.

Highest-signal resume keywords

• Quantitative User Research
• Statistical Modeling
• Survey Methodology
• R or Python and SQL
• Data Visualization

ATS Optimization Keywords

Hard Skills

• Metric Development
• Construct Definition
• Survey Validation
• Experimental Validation
• Behavioral Proxy Modeling
• Reliability Testing
• Sensitivity Testing
• Machine Learning Model Evaluation
• Behavioral Analysis
• Deep-Dive Learning Analyses

Soft Skills

• Collaboration
• Mentoring
• Presentation Skills
• Strategic Development

Certifications & Qualifications

• PhD in Computational Social Science
• PhD in Statistics
• PhD in Computer Science

Industry Keywords

• Consumer Data
• User-Centered Metrics
• Experimentation Planning
• Model Stewardship
• Cross-Functional Partnerships

Tools & Technologies

• AI Tools
• Data Visualization Tools