Multimodal AI Research Scientist for Real-Time Care Remote

Sword Health; Reims; On-site; EUR 71,000 - 110,000; Full time

Benefits offered by this job

Health, dental and vision insurance

Meal allowance

Equity shares

Remote work allowance

Flexible working hours

Work from home

Discretionary vacation

Snacks and beverages

Job summary

Sword Health is seeking a PhD-level AI researcher to push multimodal AI for clinical care. You will fine‑tune vision‑language and speech‑language models, build unified patient understanding from video, language and speech, and collaborate with AI Engineering, Product and Clinical teams to deploy safe, scalable care AI.

You’ll publish in AI venues, design rigorous experiments, and help shape long‑term goals like real‑time patient state estimation and clinical memory, with impact across a 24/7 AI

Qualifications

• PhD in Computer Science, Machine Learning, NLP, CV, or related AI field.
• Hands-on experience fine-tuning large language models or multimodal LLMs (vision-language, speech-language), including SFT, RLHF, or related post-training techniques.
• Experience training or fine-tuning models across multiple modalities (video + language, image + text, speech + text).
• Strong publication track record in peer-reviewed AI conferences or journals.
• Proficiency in Python and deep experience with modern ML frameworks (PyTorch, JAX).
• Demonstrated ability to design rigorous experiments and interpret their results.

Responsibilities

• Design and execute research on multimodal model training with a primary focus on vision‑language models and, increasingly, speech‑language models, including fine‑tuning, alignment, and post‑training methods (SFT, RLHF) tailored for clinical domains.
• Develop and improve models that enable our AI agents to perceive and understand patients through video, language, and speech, building towards unified multimodal patient understanding.
• Contribute to the full model development cycle: multimodal dataset curation and annotation, architecture design, cross‑modal training strategies, evaluation, and iteration.
• Collaborate across AI Engineering, Product, and Clinical teams to translate multimodal research breakthroughs into production systems that deliver patient care.
• Work towards long‑term ambitious research goals — such as real‑time multimodal patient state estimation, clinical memory, and safety validation — while identifying and delivering immediate milestones.
• Advance the field by publishing in top‑tier AI venues and clinical journals, contributing to Sword’s growing body of peer‑reviewed research.

Skills

Multimodal ML

Fine-tuning LLMs

Video+Language models

RLHF / SFT

Experiment design

Publications track record

Python

Education

PhD in CS/ML/NLP/CV

Tools

PyTorch

JAX

Job description

Sword Health is seeking a PhD-level AI researcher to push multimodal AI for clinical care. You will fine‑tune vision‑language and speech‑language models, build unified patient understanding from video, language and speech, and collaborate with AI Engineering, Product and Clinical teams to deploy safe, scalable care AI.

You’ll publish in AI venues, design rigorous experiments, and help shape long‑term goals like real‑time patient state estimation and clinical memory, with impact across a 24/7 AI