AI product analyst for clinical workflows

MEDvidi, Inc.; United States; Remote; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health insurance after probation

Wellness stipend

Personal English lessons

Remote-first / long-term collaboration

Job summary

MEDvidi, Inc. ищет специалиста по Product Analytics, который возьмет на себя полный стек аналитики для AI и обычных функций продукта.

Ваша задача — проектировать эксперименты, анализировать конверсии и поведение пользователей, работать с логами и транскриптами, выявлять паттерны и оценивать влияние автоматизации на клинические процессы. Ваша работа будет тесно связана с командами Product, Engineering, Clinical и Legal, и предполагает удаленную работу с возможностью CET-синхронности.

Qualifications

• 5+ лет опыта в Product Analytics/Operational Analytics/Data Analytics в сложных системах.
• Понимание AI, ML и LLM-систем.
• Умение превращать анализ в понятные решения для бизнеса.
• Уверенная работа в условиях неопределенности и изменений.
• Сильный бэкграунд в продуктовой/операционной аналитике; владение SQL и Python.
• Свободное владение русским; английский B2+; возможность работать по CET во взаимодействии с партнерами.
• Будет плюсом: опыт оценки вывода LLM и пайплайнов.

Responsibilities

• Владение полным стеком аналитики продукта для функций команды.
• Анализ поведения AI и автоматизаций по клиническим и операционным маршрутам.
• Исследование галлюцинаций, сбоев и деградации качества вывода ИИ.
• Работа с логами, транскриптами и операционными данными для выявления паттернов.
• Проектирование оценок качества AI — автоматических и ручных.
• Разработка мониторинга и дашбордов для AI и автоматизации.
• Измерение влияния автоматизации на бизнес и риски.

Skills

Product analytics

SQL

Python

Russian fluent

English B2+

Experiment design

Remote collaboration

Tools

SQL

Python

Job description

Описание:

At MEDvidi, the Automation team builds and operates a mix of AI and conventional product features that automate clinical and operational workflows - from AI-drafted medical documentation to automated resolution of patient issues, intake verification flows, provider tooling, and the backend pipelines behind them. We free clinicians and operations from manual work a machine can do reliably and safely, in a domain where mistakes have real clinical and compliance consequences. It's a full-stack product team, not an AI lab: we ship UI, backend workflows, integrations, and AI features side by side, and we measure them the same way.

Задачи:

Own the full product analytics stack for features the team ships - discovery and sizing, experiment design and analysis, funnel and adoption analysis, post-release impact assessment - across both AI-powered and conventional product features. Analyze production behavior of AI and automation workflows across clinical and operational journeys. Investigate hallucinations, silent failures, and quality degradation in AI-generated output. Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss. Design evaluations for AI quality - both automated and human review - and close the loop into prompt and product changes. Build monitoring and dashboards for AI and automation health, and the operational metrics they roll up to. Measure business and operational impact of automation initiatives and surface the risks they introduce. Partner closely with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity.

Требования:

• 5+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems.
• Understanding of AI, ML, and LLM systems.
• Effective, structured written and verbal communication - able to turn analysis into crisp, decision-ready writeups that non-analysts can act on.
• Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed.
• Strong product / operational analytics background, comfortable owning metrics end-to-end and writing SQL and Python code against messy production data.
• Fluent Russian; English level B2 or higher, Ability to work CET-overlapping hours in a B2B format.
• Будет плюсом: Hands-on experience evaluating LLM or AI output - prompt iteration, eval frameworks and human review pipelines is a strong plus; Experience evaluating LLM outputs or AI systems; Previous experience in Data Science or Machine Learning.

Условия:

• High-impact environment: A chance to influence how AI is used in real patient interactions.
• Growth & compensation: Competitive compensation and clear growth opportunities.
• Remote-first: Fully remote, long-term B2B collaboration.
• Health & wellness: Health insurance after the probation period, plus sports & wellness compensation.
• Career development: Career growth, including personalized English lessons via Preply.
• Time off: 19 working days of vacation per year, 4 additional wellness days, and paid sick leave for the first 5 working days.
• Culture: Thoughtful gifts for important life events.