Senior Quantitative UX Researcher — AI Systems & Metrics

Socket.dev; Sunnyvale (CA); On-site; USD 159,000 - 230,000; Full time

Job summary

Socket.dev is seeking a Senior Quantitative UX Researcher to join our AI infrastructure team in Sunnyvale, California. You will collaborate with Engineering and Product Management to translate complex telemetry into actionable user insights and guide product decisions across developer tools.

You will design and run experiments, analyze logs and behavioral data, and develop measurement frameworks that improve frictionless, high-velocity workflows for developers working with agentic AI.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 6 years of product research experience in an applied setting.
• Experience in quantitative research, logs analysis, metrics analysis.
• Experience researching AI/ML products, Developer APIs, or technical infrastructure.
• Experience using Python or similar for data manipulation.
• Master's or PhD in related field.
• 5 years UX research with executive leadership.
• Experience with code reviews.
• Experience analyzing telemetry/log data to inform product decisions.
• Experience with agentic AI tools and AI training methods.

Responsibilities

• Design and implement pipelines to parse and analyze massive-scale system logs to accelerate insight generation.
• Define and track system KPIs, backend performance metrics, and Product Health indicators tied to Critical User Journeys.
• Develop scripts or wrappers to parse logs and transform them into statistically validated patterns.
• Lead design and analysis of complex experiments, multivariate testing, and rollout strategies.
• Collaborate with Infrastructure Engineers, Applied Data Scientists, and ML researchers for proper instrumentation.

Skills

Quantitative research

Logs analysis

Data analysis

Regression analysis

Python programming

Education

Master's or PhD in related field

Tools

Agentic AI tools

Code reviews

Job description

Socket.dev is seeking a Senior Quantitative UX Researcher to join our AI infrastructure team in Sunnyvale, California. You will collaborate with Engineering and Product Management to translate complex telemetry into actionable user insights and guide product decisions across developer tools.

You will design and run experiments, analyze logs and behavioral data, and develop measurement frameworks that improve frictionless, high-velocity workflows for developers working with agentic AI.