AI Product Leader — Conversational Analytics & QA

Capital One; Chicago (IL); On-site; USD 183,000 - 208,000; Full time

Job summary

Capital One is seeking a senior manager to direct strategy for evaluating conversational AI, leading analytics pillars, and scaling automated validation across customer interactions. You will oversee AI QA on AI, ensure scalable QA systems, and drive cross-functional workstreams with product, engineering, and data science teams.

The role emphasizes strategic systems-thinking, leadership of people, and experience shipping data platforms or cloud-scale conversational apps.

Qualifications

• Bachelor's or Master’s degree in a quantitative field or related field, or a combination of degree and PM experience.
• Experience leading product management for data platforms or cloud-scale conversational apps.
• Deep knowledge of LLM evaluation pipelines and analytics workflows.

Responsibilities

• Own platform integration and roadmap for onboarding conversational AI solutions.
• Design scalable QA and analytics infrastructure for insight-driven decisions.
• Lead core analytics workstreams including transcript-level LLM intelligence and natural language querying.
• Mentor and develop product and analytics teams, align backlogs with executive priorities.

Skills

Product management

LLM evaluation pipelines

Team management

Strategic systems-thinking

Education

Bachelor's or Master’s Degree in a quantitative field

Bachelor's degree + 4 years PM experience

Job description

Capital One is seeking a senior manager to direct strategy for evaluating conversational AI, leading analytics pillars, and scaling automated validation across customer interactions. You will oversee AI QA on AI, ensure scalable QA systems, and drive cross-functional workstreams with product, engineering, and data science teams.

The role emphasizes strategic systems-thinking, leadership of people, and experience shipping data platforms or cloud-scale conversational apps.