Product Manager, Restaurant AI Evaluation

Toast, Inc.; United States; Hybrid; USD 138,000 - 221,000; Full time

Job summary

Toast, Inc. is seeking a Product Manager for Toast IQ Evaluation. You will define what good help looks like for restaurant operators, study real usage, and build datasets and quality standards for improvement.

This hands-on role centers on reviewing sessions, labeling examples, and turning findings into actionable product decisions. You will collaborate with engineers across Toast, act as the restaurant domain expert, and help teams prioritize issues from a prioritized backlog.

Qualifications

• Restaurant knowledge from hands-on experience with operators.
• Comfort labeling transcripts and maintaining large datasets.
• Ability to explore data using databases/queries and verify results.

Responsibilities

• Understand the operator’s experience by reviewing Toast IQ sessions weekly.
• Identify and prioritize recurring failures and measure impact on operators.
• Build and maintain labeled evaluation datasets for common workflows and edge cases.
• Validate improvements in live sessions and craft regression cases for future releases.
• Lead calibration sessions with reviewers and help product teams create evaluation cases.
• Surface tools and workflows that need attention and inform product decisions.

Skills

Restaurant knowledge

Attention to detail

Structured data analysis

Precise thinking

Clear communication

Curiosity about AI

Toast products familiarity

Tools

AI coding tools

Job description

Toast, Inc. is seeking a Product Manager for Toast IQ Evaluation. You will define what good help looks like for restaurant operators, study real usage, and build datasets and quality standards for improvement.

This hands-on role centers on reviewing sessions, labeling examples, and turning findings into actionable product decisions. You will collaborate with engineers across Toast, act as the restaurant domain expert, and help teams prioritize issues from a prioritized backlog.