Product Manager, AI Product

Caseware; Toronto; Hybrid; CAD 120,000 - 130,000; Full time

Benefits offered by this job

Health insurance

Retirement plans

Performance bonuses

Flexible work options

Generous time-off policies

Job summary

Caseware is seeking a Product Manager in Toronto to lead AI initiatives within their platform. This hybrid role involves working closely with engineering, designing evaluation frameworks, and ensuring AI outputs meet professional standards. Ideal candidates will have over 4 years of product management experience, particularly with AI products, and possess the ability to collaborate with domain experts. A supportive and innovative work culture awaits, along with competitive compensation ranging from $120,000 to $130,000 CAD annually.

Qualifications

• 4+ years of experience in technology-focused product management or development.
• Direct experience building and running evaluation frameworks for AI products.
• Comfortable discussing technical topics related to AI with engineers.

Responsibilities

• Drive high-impact AI initiatives within the Caseware platform.
• Design and run rigorous evaluation frameworks for AI outputs.
• Work daily with engineering to translate precise problem statements into product requirements.
• Validate AI outputs against professional standards with domain experts.

Skills

AI initiatives management

Evaluation frameworks for AI products

Technical fluency in LLMs

High agency

Curiosity about AI

Experience with domain experts

Comfortable with ambiguity

Job description

Caseware is a leading Fintech company in audit and accounting software, serving over 500,000 users across 130 countries.

We are looking for a Product Manager to own the development of AI capabilities within the Caseware platform.

Location: Hybrid role – the successful candidate will work 3 days a week in our Toronto office at 351 King St E, Toronto, ON.

This is a full‑time position and a new role.

What you will be doing

• Drive high‑impact AI initiatives within the Caseware platform transformation – shape priorities and sequencing for your workstream, grounded in user research, domain expertise, and a clear view of technical feasibility.
• Design and run rigorous evaluation frameworks: build golden datasets, define task taxonomies, write rubrics that score AI outputs the way a senior practitioner would, and run structured eval cycles before and after every major release.
• Work daily with engineering to translate precise problem statements into well‑scoped product requirements, including clear acceptance criteria and evaluation bars before development begins.
• Embed with domain experts and partner accounting and audit firms to validate AI outputs against professional standards – not just user preferences, but what a qualified practitioner would actually sign off on.
• Drive continuous discovery with practitioners: shadow workflows, test prototypes in context, and turn "this doesn’t feel right" into specific, actionable failure modes.
• Stay ahead of the AI landscape – monitor model developments, new architectures, emerging agent patterns, and competitor moves, and bring a clear point of view on what matters for Caseware.
• Define and own product health metrics for AI features: task completion, correction rates, override frequency, trust signals, and time‑to‑completion – and use them to drive product decisions.
• Synthesize signals across engineering, partners, domain experts, customer success, and leadership into a coherent product direction – and communicate it with clarity at every level of the organization.

What you will bring

• 4+ years of experience in technology‑focused product management or product development, including 1–2 years working deeply with AI or machine learning‑driven products.
• Direct experience building and running evaluation frameworks for AI products – golden datasets, rubrics, human‑in‑the‑loop validation, and regression tracking across releases.
• Technical fluency in LLMs, RAG, prompt engineering, embeddings, and agentic patterns – enough to have substantive conversations with engineers and know when a product problem is a model problem.
• High agency: you identify what needs to happen, move without waiting to be told, and take ownership of outcomes rather than just activities.
• Genuine curiosity about AI – you follow model releases, read research, understand what frontier labs are shipping, and form your own views on what matters.
• Experience working with domain experts or subject‑matter specialists to define quality bars in high‑stakes, regulated, or professional‑grade contexts.
• Comfortable with ambiguity. Many of the problems this role works on do not have clear playbooks – you are energized by that, not slowed down by it.

Salary Range

The annual base salary for this position is between $120,000 CAD and $130,000 CAD per year.

Benefits

• Innovation is at our core – we work with cutting‑edge technology in accounting and financial reporting, constantly pushing boundaries to create impactful software solutions.
• Collaborative culture – your ideas are valued and knowledge sharing is encouraged within a supportive, inclusive team.
• Work‑life balance – flexible work options, remote opportunities, and generous time‑off policies to maintain a healthy balance.
• Competitive compensation and comprehensive benefits, including health insurance and retirement plans.
• Impactful work – your contributions directly affect how clients manage financial processes and drive their success.
• Recognition and rewards – performance bonuses, recognition programs, and opportunities for career growth.
• Global opportunities – work on international projects and collaborate with a diverse, global team.

Equal Opportunity Statement

We welcome and encourage candidates of all backgrounds to apply. If you require accommodations or have any questions at any point during the application or interview process, please e‑mail our People Operations team at [e-mail].