Senior UX Quantitative Researcher for Agentic AI Ad Sales

Google; Mountain View (CA); On-site; USD 188,000 - 274,000; Full time

Job summary

Google is seeking a User Experience Researcher (UXR) to join our multi-disciplinary UX team, collaborating with Engineering and Product Management to gather insights and create industry-leading products.

You will lead primary research such as field studies, interviews, diary studies, ethnography, surveys, usability testing, and logs analysis, driving impact at all stages of product development and ensuring products are useful, usable, and helpful.

Qualifications

• Bachelor's degree in Human-Computer Interaction, Cognitive Science, Statistics, Psychology, Anthropology, a related field, or equivalent practical experience.
• 8 years of experience in an applied research setting, or similar.
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience with agentic AI evaluation: evaluating multi-agent architectures, agentic workflows, orchestrators, or subagent routing systems.

Responsibilities

• Apply statistical methods (e.g., statistical inference, regression modeling, experimental design) to analyze large-scale log data, survey data, and other behavioral data.
• Partner with product managers, engineers, and designers to identify research opportunities, define user-centered success metrics, and ensure appropriate data instrumentation.
• Translate complex findings into actionable insights and communicate them effectively to cross-functional stakeholders at various levels. Ensure research doesn't just result in a report, but in a shipped product that moves the needle on revenue and seller effectiveness.
• Collaborate with qualitative UXRs, data scientists, and business analysts to triangulate findings and provide a holistic view of the user experience.
• Design and analyze human and synthetic evaluation systems, applying crossed rater/item statistical models and bradley-terry preference frameworks to calibrate agent routing quality and mitigate rater bias.

Skills

UX research

Applied research

Programming languages

Agentic AI evaluation

Project management

Education

Bachelor's degree in HCI etc.

Job description

Google is seeking a User Experience Researcher (UXR) to join our multi-disciplinary UX team, collaborating with Engineering and Product Management to gather insights and create industry-leading products.

You will lead primary research such as field studies, interviews, diary studies, ethnography, surveys, usability testing, and logs analysis, driving impact at all stages of product development and ensuring products are useful, usable, and helpful.