AI Health Research Engineer: Evaluation Pipelines

Path International; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

PATH is seeking a Research Engineer to design and run evaluation pipelines for AI in health. You will simulate users, score conversations, and analyze results to inform safe and effective mental health tools. You will collaborate with international partners and contribute to open-source tooling.

You will work in PATH’s London office, engaging with clinical and policy colleagues, and occasionally travel internationally as part of the AI for Health initiative.

Qualifications

• BSc or MSc in computer science, software engineering, or related field, or equivalent practical experience.
• Strong Python skills with well-tested, maintainable code and CI.
• Experience evaluating AI models via evaluation pipelines or large-scale research contributions.

Responsibilities

• Build and run benchmarking pipelines for AI evaluation across global health contexts.
• Develop tools to support user simulation and LLM-judging, with robust documentation.
• Support PATH's AI for Health research portfolio and publish results when possible.

Skills

Python

CI/CD

Cloud (AWS/GCP/Azure)

Docker

End-to-end evaluation

Multilingual NLP

Playwright

Education

BSc or MSc in computer science or related field

Tools

Docker

Playwright

CI/CD tools

AWS

Job description

PATH is seeking a Research Engineer to design and run evaluation pipelines for AI in health. You will simulate users, score conversations, and analyze results to inform safe and effective mental health tools. You will collaborate with international partners and contribute to open-source tooling.

You will work in PATH’s London office, engaging with clinical and policy colleagues, and occasionally travel internationally as part of the AI for Health initiative.