Senior AI Product Analyst, Automation & Analytics, Remote

MEDvidi, Inc.; Województwo mazowieckie; Remote; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Remote-first

Health insurance

Career development

English lessons via Preply

Vacation days: 19 + 4 wellness days

Job summary

MEDvidi is seeking a Product Analyst to own analytics end-to-end for our automation and AI-powered features. You will translate production behavior into actionable insights, quantify performance, and guide product decisions across clinical and operational workflows.

The role blends product analytics, AI evaluation, and operational analysis in a fully remote, B2B setup. You will collaborate with Product, Engineering, MedOps, Clinical, and Legal to drive fast decisions in ambiguous environments.

Qualifications

• 5+ years of experience in Product Analytics/Operational Analytics/Data Analytics.
• Understanding of AI, ML, and LLM systems.
• Experience evaluating LLM or AI output; prompt iteration and eval frameworks is a strong plus.
• Excellent written and verbal communication; able to turn analysis into decision-ready writeups.
• Comfort in ambiguous, fast-changing environments with constructed ground truth.
• Strong analytics background; end-to-end metrics; SQL and Python against production data.
• Fluent Russian; English level B2 or higher.
• Ability to work CET-overlapping hours in a B2B format.

Responsibilities

• Own the full product analytics stack for features the team ships - discovery and sizing, experiment design and analysis, funnel and adoption analysis, post-release impact assessment - across both AI-powered and conventional product features.
• Analyze production behavior of AI and automation workflows across clinical and operational journeys.
• Investigate hallucinations, silent failures, and quality degradation in AI-generated output.
• Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss.
• Design evaluations for AI quality - both automated and human review - and close the loop into prompt and product changes.
• Build monitoring and dashboards for AI and automation health, and the operational metrics they roll up to.
• Measure business and operational impact of automation initiatives and surface the risks they introduce.
• Partner closely with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity.

Skills

Product Analytics

Operational Analytics

Data Analytics

SQL

Python

AI/LLM knowledge

Communication

Ambiguity handling

Tools

SQL

Python

Job description

MEDvidi is seeking a Product Analyst to own analytics end-to-end for our automation and AI-powered features. You will translate production behavior into actionable insights, quantify performance, and guide product decisions across clinical and operational workflows.

The role blends product analytics, AI evaluation, and operational analysis in a fully remote, B2B setup. You will collaborate with Product, Engineering, MedOps, Clinical, and Legal to drive fast decisions in ambiguous environments.