Product Manager, AI Evaluation & Quality

Toast; United States; Hybride; USD 125 000 - 254 000; Plein temps

Résumé du poste

Toast IQ Evaluation Product Manager will define what good help looks like for a restaurant operator and build the evidence that tells us whether Toast IQ delivers it. You’ll study real usage, work directly with operators, and turn what you learn into datasets, clear quality standards, and priorities for improvement.

Your work will help teams across Toast understand where the assistant succeeds, where it falls short, and identify new opportunities for improvement. This is a hands‑on product role.

Qualifications

• Restaurant knowledge: understanding how menus, labor, sales and inventory affect operations.
• Care for detailed work: comfortable reading transcripts and labeling data.
• Structured data: ability to investigate data with databases or AI tools and trust results.
• Precise thinking and writing: convert observations into clear rules.
• Clear communication: explain findings to engineers, product teams and leadership.

Responsabilités

• Understand the operator’s experience by reviewing Toast IQ sessions and describing what went wrong in operator language.
• Identify and prioritize recurring failures; measure frequency and impact to guide fixes.
• Create and maintain labeled evaluation datasets covering common workflows and edge cases.
• Verify improvements in live sessions and convert failures into regression issues for future releases.
• Support Toast teams by calibrating reviewers and creating evaluation cases for capabilities.
• Highlight tools and workflows that don’t add value and propose product actions.

Connaissances

Restaurant knowledge

Attention to detail

Structured data familiarity

Clear communication

Curiosity about AI systems

Toast product familiarity

Description du poste

Toast IQ Evaluation Product Manager will define what good help looks like for a restaurant operator and build the evidence that tells us whether Toast IQ delivers it. You’ll study real usage, work directly with operators, and turn what you learn into datasets, clear quality standards, and priorities for improvement.

Your work will help teams across Toast understand where the assistant succeeds, where it falls short, and identify new opportunities for improvement. This is a hands‑on product role.