Founding Data Scientist — AI Metrics & Product Lead

HappyRobot; San Francisco (CA); On-site; USD 130,000 - 180,000; Full time

Benefits offered by this job

Healthcare coverage

Dental coverage

Vision coverage

Job summary

HappyRobot in San Francisco is seeking a data-driven analytics professional to measure how changes to models, agents, and product features impact real-world performance. You will define metrics, design experiments, and analyze millions of conversations to guide product and ML roadmaps.

Collaborating with Product, Engineering, and Machine Learning teams, you will build dashboards and self-serve tools, translate complex findings into actionable recommendations, and help scale HappyRobot's

Qualifications

• 4+ years of experience in Data Science, Product Analytics, or another highly quantitative product role.

Responsibilities

• Define and track product, feature, and agent-level metrics.
• Design, run, and interpret A/B tests for model changes, prompts, agent behavior, workflows, and product features.
• Measure how the performance of our agents affects client outcomes, such as task completion and operational efficiency.
• Connect offline model evaluations with production performance and real-world customer impact.
• Conduct deep analyses across conversations, workflows, and product usage to identify opportunities and explain differences in performance.
• Investigate anomalies and regressions, perform root-cause analyses, and recommend improvements.
• Build statistical models, simulations, and analytical frameworks to support product and ML decisions.
• Partner with Engineering to improve instrumentation, data quality, experimentation systems, and analytical data models.
• Build dashboards and self-serve tools that help teams understand product and agent performance.
• Communicate findings and recommendations clearly to technical and non-technical stakeholders.

Skills

Data Science

Product Analytics

Experimental design

SQL

Python

A/B testing

Statistics

Cross-functional collaboration

Job description

HappyRobot in San Francisco is seeking a data-driven analytics professional to measure how changes to models, agents, and product features impact real-world performance. You will define metrics, design experiments, and analyze millions of conversations to guide product and ML roadmaps.

Collaborating with Product, Engineering, and Machine Learning teams, you will build dashboards and self-serve tools, translate complex findings into actionable recommendations, and help scale HappyRobot's