Senior AI Product Analyst — Automation & AI Quality

MEDvidi, Inc.; Barcelona; Remote; EUR 55,000 - 90,000; Full time

Benefits offered by this job

Health & wellness compensation

Career growth

Remote-first

Job summary

MEDvidi, Inc. is seeking a Product Analyst to own analytics for our team’s product features, including AI-powered ones, and to translate system behavior into actionable insights.

You will work across clinical and operational journeys, designing experiments, dashboards, and evaluations to improve AI quality and business impact. A collaborative, fast-paced environment awaits, with a remote-first setup.

Qualifications

• 5+ years in Product Analytics or related analytics within complex production systems.
• Understanding of AI, ML, and LLM systems.
• Experience evaluating LLM output, eval frameworks, and human review pipelines is a strong plus.
• Effective written and verbal communication, turning analysis into decision-ready writeups.
• Comfort in ambiguous, fast-changing environments.
• Strong product/operational analytics background, writing SQL and Python against messy production data.
• Fluent Russian; English level B2 or higher.
• Ability to work CET-overlapping hours in a B2B format.

Responsibilities

• Own the full product analytics stack for features the team ships, across AI-powered and conventional features.
• Analyze production behavior of AI and automation workflows across clinical and operational journeys.
• Investigate hallucinations, silent failures, and quality degradation in AI-generated output.
• Work with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss.
• Design evaluations for AI quality—automated and human review—and close the loop into prompt and product changes.
• Build monitoring and dashboards for AI and automation health and the metrics they roll up to.
• Measure business and operational impact of automation initiatives and surface risks.
• Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity.

Skills

Product analytics

SQL

Python

AI/ML/LLM

Communication

Data analysis

Tools

SQL

Python

Job description

MEDvidi, Inc. is seeking a Product Analyst to own analytics for our team’s product features, including AI-powered ones, and to translate system behavior into actionable insights.

You will work across clinical and operational journeys, designing experiments, dashboards, and evaluations to improve AI quality and business impact. A collaborative, fast-paced environment awaits, with a remote-first setup.