Voice AI Product Analyst — Production & Insights

MEDvidi, Inc.; Warszawa; Remote; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Remote-first culture

Competitive compensation

English lessons via Preply

Job summary

MEDvidi is seeking an AI Product Analyst to evaluate and improve Voice AI systems used in patient interactions. You will work across Product, Engineering, Operations, and AI to understand AI behavior in production, identify failures, and propose enhancements.

Responsibilities include analyzing conversations, building evaluation frameworks, and developing dashboards to monitor AI performance and impact on patient experience.

Qualifications

• 5+ years of experience in Product Analytics or related roles.
• Strong SQL skills and ability to work with large datasets.
• Experience with ML pipelines or AI-powered products is a plus.

Responsibilities

• Analyze production behavior of Voice AI Agents and conversational AI workflows.
• Investigate hallucinations, inconsistencies, and quality degradation in AI-driven conversations.
• Work with transcripts, logs, outputs, and datasets to derive actionable insights.
• Design evaluation frameworks for AI quality, reliability, and business impact.
• Build monitoring systems and dashboards for AI performance visibility.
• Measure AI impact on operational efficiency and patient experience.
• Partner with Product, Engineering, QA, and Operations on AI initiatives.

Skills

Product analytics

Russian language

English communication (B2+)

Ambiguity tolerance

Cross-functional collaboration

Tools

SQL

Python

ML pipelines

Monitoring dashboards

Job description

MEDvidi is seeking an AI Product Analyst to evaluate and improve Voice AI systems used in patient interactions. You will work across Product, Engineering, Operations, and AI to understand AI behavior in production, identify failures, and propose enhancements.

Responsibilities include analyzing conversations, building evaluation frameworks, and developing dashboards to monitor AI performance and impact on patient experience.