Senior AI Product Analyst, Voice AI (Remote)

MEDvidi, Inc.; Polska; Hybrid; PLN 180,000 - 320,000; Full time

Benefits offered by this job

Fully remote

Health insurance after probation

Wellness compensation

English lessons

Vacation days

Sick leave

Job summary

MEDvidi is hiring an AI Product Analyst to evaluate and improve Voice AI systems at scale. You will analyze real-world conversations, transcripts, and outputs to understand how AI behaves, where it adds value, and where it fails. You will build dashboards and evaluation frameworks to guide product decisions and improve patient experiences.

Join a remote-first, B2B environment focused on healthcare AI, with opportunities for growth and exposure to cutting-edge conversational AI challenges.

Qualifications

• 5+ years of experience in Product Analytics, Data Analytics, or related roles in complex production systems.
• Strong SQL skills and experience with Python for data analysis.
• Experience with ML pipelines or AI-powered products and understanding of AI failures.

Responsibilities

• Analyze production behavior of Voice AI Agents and conversational flows.
• Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI conversations.
• Work with transcripts, logs, and operational data to uncover patterns and insights.
• Design evaluation frameworks for AI quality, reliability, and business impact.
• Build monitoring dashboards for AI performance visibility.
• Assess impact of AI on operations, outcomes, and patient experience.
• Collaborate with Product, Engineering, QA, and Operations teams.

Skills

SQL

Python

LLM evaluation

Data analytics

Stakeholder communication

Tools

ML pipelines

Job description

MEDvidi is hiring an AI Product Analyst to evaluate and improve Voice AI systems at scale. You will analyze real-world conversations, transcripts, and outputs to understand how AI behaves, where it adds value, and where it fails. You will build dashboards and evaluation frameworks to guide product decisions and improve patient experiences.

Join a remote-first, B2B environment focused on healthcare AI, with opportunities for growth and exposure to cutting-edge conversational AI challenges.