Senior AI/ML engineer

Flo Health Inc.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Competitive salary

Performance bonus

Holiday & sick leave

Parental leave

Professional growth

Hybrid work with office presence

Sabbatical

Job summary

Flo Health Inc. is seeking a Senior AI Engineer to join the AI Platform team in a hybrid London-based role. You’ll ship AI-driven features like personalized content recommendations, conversational insights, and smart push notifications, focusing on relevance, quality, latency, and safety.

You will iterate on prompts, fine-tune health-domain models, and contribute to infrastructure work across Databricks, AWS, Terraform, and CI/CD as needed.

Qualifications

• 7+ years of software engineering with hands-on LLM product features.
• Experience in prompt engineering, LLM evaluation, or fine-tuning.
• Strong Python; comfortable with APIs/SDKs wrapping LLM calls.
• Product sense with focus on latency, tone, and AI output quality.
• Willingness to learn Databricks, AWS, Terraform and related tools.

Responsibilities

• Feature development: ship LLM-powered product features including AI-generated notifications and personalized in-app content.
• Latency and UX: reduce perceived latency and improve user experience with streaming and inference-time tradeoffs.
• Prompt and model behaviour: iterate on prompts, use health-domain models, and ensure safe outputs.
• Experimentation: enable A/B testing and use evaluation gates to ship safely.
• Data and evaluation: design synthetic QA data and evaluation sets to support features.
• Infrastructure: contribute to Databricks, AWS, Terraform, or CI/CD as needed.
• Cross-functional impact: collaborate with Product, Security, Analytics, and Medical teams.

Skills

LLM engineering

Python

Prompt design

Model serving

A/B testing

Infra tools

Tools

Databricks

AWS

Terraform

GitHub Actions

Job description

500M+ downloads. 80M+ monthly users. A decade of building – and we’re still accelerating.

Flo is the world’s #1 health & fitness app worldwide on a mission to build a better future for female health. Backed by a $200M investment led by General Atlantic, we became the first product of our kind to reach a $1B valuation in 2024 – and we’re not slowing down.

With 7M paid subscribers and the highest-rated experience in the App Store’s health category, we’ve spent 10 years earning trust at scale. Now, we’re building the next generation of digital health – AI-powered, privacy-first, clinically backed – to help our users know their body better.

The job

We are looking for a Senior AI Engineer with strong LLM and product engineering experience to join our AI Platform team and help ship the AI-driven features across our app — including personalized in-app content recommendations, conversational AI-powered insights, and AI-generated mobile push notifications. You will focus on the product-facing behavior of our GenAI features (relevance, quality, latency, and safety), using the platform’s judges, fine-tuning pipelines, and evaluation tools, and contributing to infrastructure work (Databricks, AWS, Terraform) as initiatives require it.

What you’ll do

• Feature development: build and ship LLM-powered product features, including AI-generated mobile push notifications, personalized in-app content recommendations and custom user journeys, and conversational AI-powered insights — including structured output such as charts and widgets
• Latency and UX: reduce perceived and actual response latency through streaming, pregeneration, and inference-time tradeoffs, working closely with product and design on how AI output is experienced by users
• Prompt and model behaviour: iterate on prompt design and calibration, use fine-tuned health-domain models (Llama, Gemma, MedGemma) where relevant, and work with the Judge-as-a-Service ecosystem to keep outputs safe and high quality
• Experimentation: help enable A/B testing for model and prompt changes, using evaluation gates to ship safely and measure impact
• Data and evaluation: contribute to synthetic Q&A generation, golden test sets, and evaluation dataset design that supports the features you’re building
• Infrastructure: contribute to Databricks, AWS (EKS), Terraform, or CI/CD work as initiatives require it
• Cross-functional impact: collaborate with Product, Security, Analytics, and Medical teams, and engage with technology partners (Databricks, Google, OpenAI, Anthropic, AWS) on pre-release capabilities relevant to your features

Experience and skills

Must have:

• 7+ years of software engineering, with recent hands-on experience building product features backed by LLMs
• experience with at least one of: prompt engineering, LLM evaluation, fine-tuning, or model serving
• strong Python, and comfort working with APIs/SDKs that wrap LLM calls, prompt templates, and structured outputs
• product sensibility: a track record of shipping user-facing features, with attention to latency, tone, and quality of AI output as experienced by end users
• comfort picking up new infrastructure tools (Databricks, AWS, Terraform, GitHub Actions) as needed — deep prior expertise not required

Nice to have:

• LLM evaluation frameworks (judges, graders, calibration methodology) or fine-tuning techniques (LoRA, RLHF/DPO, model distillation)
• prompt optimisation frameworks (DSPy or similar)
• feature stores or personalization/ranking experience (relevant to in-app content recommendation work)
• healthcare, regulated-industry, or safety-critical AI systems experience

Annual Salary Range (ranges may vary based on skills and experience)

How we work

We’re a mission-led, product-driven team. We move fast, stay focused and take ownership – from brief to build to impact. Debate is encouraged. Decisions are shared. We care about craft, ship with purpose, and always raise the bar.

You’ll be working with people who take their work seriously, not themselves. It takes commitment, resilience, and the drive to keep going when things get tough. Because better health outcomes are worth it.

What you'll get

We support impact with meaningful reward. Here’s what that looks like:

• Competitive salary and annual reviews
• Opportunity to participate in Flo’s performance incentive scheme
• Paid holiday, sick leave, and female health leave
• Enhanced parental leave and pay for maternity, paternity, same-sex and adoptive parents
• Accelerated professional growth through world-changing work and learning support
• In-person collaboration and work in a hybrid model, with 3 days per week spent in the office
• 5-week fully paid sabbatical at 5-year Floversary
• Flo Premium for friends & family, plus more health, pension and wellbeing perks

Diversity, equity and inclusion

Our strength is in our differences. At Flo, hiring is based on merit, skill and what you bring to the role – nothing else. We’re proud to be an equal opportunity employer, and we welcome applicants from all backgrounds, communities and identities. Read our privacy notice for job applicants .