AI/ML Data Scientist — Hybrid London, Own AI Benchmarks

Medly AI

Greater London

Hybrid

GBP 65,000 - 90,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Medly AI in London is seeking an AI/ML Data Scientist to own how we measure and improve our AI models. You’ll work with founders and engineers who’ve built at Meta and Atlassian, designing benchmarks, evals, and experiments that deliver real improvements for students.

From day one you’ll own the work: develop subject-specific evals, improve offline test suites, run experiments, build tuning datasets, and translate pedagogical judgement into measurable signals.

Qualifications

  • 2+ years in data science, ML, or applied research after graduation.
  • Experience evaluating or benchmarking AI/ML systems with measurable metrics.
  • Strong Python data skills (pandas, numpy) and readable code.
  • Proficient SQL and relational databases.
  • Solid grounding in statistics and experimental design.
  • Familiarity with LLMs, evaluation, prompting, and fine-tuning.
  • Degree in CS, Maths, Physics, Statistics, Engineering, Data Science, or similar.

Responsibilities

  • Own AI benchmarking and create subject-specific evals for tutoring and content generation.
  • Improve eval harnesses and offline test suites to ship model changes confidently.
  • Run experiments and A/B tests on live AI features and interpret results.
  • Build and curate high-quality datasets for fine-tuning and evaluation.
  • Investigate model failures end to end and turn findings into fixes.
  • Collaborate with learning developers and teachers to quantify pedagogical judgement.
  • Work with product data to surface insights and shape future features.
  • Contribute to the codebase (Python, Postgres, AWS, Next.js) where relevant.

Skills

Python
SQL
Statistics
Experiment design
LLMs
Eval frameworks
AWS

Education

Quantitative degree (CS, Maths, Physics, Statistics, Engineering, Data Science)

Tools

AWS

Job description

Medly AI in London is seeking an AI/ML Data Scientist to own how we measure and improve our AI models. You’ll work with founders and engineers who’ve built at Meta and Atlassian, designing benchmarks, evals, and experiments that deliver real improvements for students.

From day one you’ll own the work: develop subject-specific evals, improve offline test suites, run experiments, build tuning datasets, and translate pedagogical judgement into measurable signals.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Data Scientist
AI/ML Data Scientist

Medly AI • Greater London

Hybrid
GBP 65,000 - 90,000
Staff Evaluations Engineer — AI Benchmarks
Staff Evaluations Engineer — AI Benchmarks

Ai • Greater London

On-site
GBP 85,000 - 130,000
30 days annual leave
Pension plan with 10% employer contrib
Bupa private health cover
+1
Production AI Engineer - Hands-on ML (Hybrid London)
Production AI Engineer - Hands-on ML (Hybrid London)

The AA • Greater London

Hybrid
GBP 85,000 - 125,000
25 days' annual leave
Up to 7% employer pension contribution
Free AA breakdown membership from Day
+2
Lead Data Scientist - AI & ML Projects (Hybrid, London)
Lead Data Scientist - AI & ML Projects (Hybrid, London)

Infused Solutions • Greater London

Hybrid
GBP 60,000 - 75,000
Bonus
Benefits package
Hybrid working
Senior ML Engineer - Production AI & MLOps (London Hybrid)
Senior ML Engineer - Production AI & MLOps (London Hybrid)

Data Idols • City Of London

Hybrid
GBP 80,000 - 110,000
Lead Data Scientist — Build the Core ML Product (Hybrid London)
Lead Data Scientist — Build the Core ML Product (Hybrid London)

Data Idols • Greater London

Hybrid
GBP 85,000 - 95,000
Equity
Senior ML QA Engineer: Benchmark & Validate AI Systems
Senior ML QA Engineer: Benchmark & Validate AI Systems

EngineersOfAI • Greater London

On-site
GBP 60,000 - 80,000
Unlimited annual leave
Up to 5% matched pension
Phantom equity
+2
Senior ML Engineer: Production AI & MLOps (Hybrid London)
Senior ML Engineer: Production AI & MLOps (Hybrid London)

Data Idols • Greater London

Hybrid
GBP 80,000 - 110,000
Lead Data Scientist — Build AI Analytics Team (London)
Lead Data Scientist — Build AI Analytics Team (London)

Harnham • Greater London

On-site
GBP 86,000 - 105,000
Competitive salary
Onsite in Central London (4 days/week)
Benefits package
Data & AI Lead — Hybrid London, Growth & Mentorship
Data & AI Lead — Hybrid London, Growth & Mentorship

Formula. • Greater London

Hybrid
GBP 90,000 - 140,000
Learning and development support
Competitive benefits package