Clinical AI Engineer: Evidence‑Driven Health Tech

Heidi; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

Heidi is seeking a Clinical AI Engineer with a medical degree and hands-on coding to own evaluation of AI products in clinical settings. You will design rigorous evaluations, build LLM-based judges, and ensure regulatory compliance while advancing product safety and scientific rigor.

You will work with a pod of engineers and clinicians to monitor performance, report findings, and push for changes based on evidence. This role emphasizes independence, scientific communication and durable impact.

Qualifications

• A medical degree and clinical practice with independent clinical judgment.
• Academic depth: study design, statistics, reliability measures and sample size.
• Experience evaluating medical software or clinical AI and building/validating ML pipelines.
• Ability to read and modify production code in Python or TypeScript.
• Prompt engineering and AI-assisted coding are daily tools here.

Responsibilities

• Design evaluations for greenfield products to academic standards.
• Build, validate and maintain LLM judges and rubrics at scale.
• Report agreement with ground truth and track drift in metrics.
• Run evaluation, statistics and write up results for multiple audiences.
• Oversee post-market surveillance and regulatory feedback responses.
• Publish findings and contribute to peer-reviewed literature.

Skills

Clinical evaluation

Study design

Statistical analysis

Regulatory understanding

Independent clinical judgment

Clear writing

Independence in project work

Communication with cross-functional

Education

Medical degree

Tools

Python

TypeScript

Job description

Heidi is seeking a Clinical AI Engineer with a medical degree and hands-on coding to own evaluation of AI products in clinical settings. You will design rigorous evaluations, build LLM-based judges, and ensure regulatory compliance while advancing product safety and scientific rigor.

You will work with a pod of engineers and clinicians to monitor performance, report findings, and push for changes based on evidence. This role emphasizes independence, scientific communication and durable impact.