Data Quality Engineer — LLM Post-Training & Evaluation

Reflection AI

Greater London

On-site

GBP 70,000 - 120,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Top-tier compensation
Comprehensive medical benefits
Fully paid parental leave
Paid time off
Daily meals provided

Job summary

A leading AI company is seeking an engineer to oversee data quality for LLM post-training. The role includes designing automated QA methods, collaborating with researchers, and ensuring high standards for training data. The ideal candidate will have strong Python skills, experience with large datasets, and a solid understanding of data quality impacts. This position offers top-tier compensation, comprehensive health benefits, and supportive family leave policies.

Qualifications

  • Strong engineering fundamentals with experience building data pipelines or QA systems.
  • Detail-oriented with an analytical mindset for identifying data quality issues.
  • Experience designing and validating automated quality checks.

Responsibilities

  • Own upstream data quality for LLM post-training and evaluation.
  • Partner closely with research teams to translate requirements into quality signals.
  • Design and scale automated QA methods to measure data quality.

Skills

Proficiency in Python
Experience with large datasets
Knowledge of LLM training and evaluation
Excellent communication skills

Job description

A leading AI company is seeking an engineer to oversee data quality for LLM post-training. The role includes designing automated QA methods, collaborating with researchers, and ensuring high standards for training data. The ideal candidate will have strong Python skills, experience with large datasets, and a solid understanding of data quality impacts. This position offers top-tier compensation, comprehensive health benefits, and supportive family leave policies.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Analysis & Evaluation for LLM Robustness
Senior Data Analysis & Evaluation for LLM Robustness

Deepstreamtech • Greater London

On-site
GBP 50,000 - 70,000
NLP/LLM Data Engineer (Contract)
NLP/LLM Data Engineer (Contract)

Future Talent Group • London

On-site
GBP 60,000 - 80,000
Domain LLM Data Annotation & QA Specialist
Domain LLM Data Annotation & QA Specialist

Eigent AI • Greater London

Hybrid
GBP 30,000 - 41,000
LLM Applications Engineer — Build & Evaluate AI Workflows
LLM Applications Engineer — Build & Evaluate AI Workflows

Xist4 IT Limited. • City Of London

Remote
GBP 90,000 - 115,000
Staff, Data Quality & LLM Evaluation (Remote-friendly)
Staff, Data Quality & LLM Evaluation (Remote-friendly)

Cohere • Greater London

Remote
GBP 60,000 - 90,000
Remote-friendly work environment
Daily lunch program for office workers
Co-working benefit for remote employees
AI Evaluation Quality Architect
AI Evaluation Quality Architect

Inquigent Ltd. • United Kingdom

Remote
GBP 65,000 - 95,000
Remote-first
Learning budget
Equipment provided
LLM Ops Engineer – Real-Time AI Pipelines
LLM Ops Engineer – Real-Time AI Pipelines

LSEG • Nottingham

On-site
GBP 70,000 - 100,000
Healthcare
Retirement planning
Paid volunteering days
+1
Senior AI Engineer — Build Production LLM Systems
Senior AI Engineer — Build Production LLM Systems

Primis • Greater London

On-site
GBP 70,000 - 90,000
Senior LLM Evaluation Scientist
Senior LLM Evaluation Scientist

Cohere • City Of London

Remote
GBP 70,000 - 120,000
Lunch stipend
Health benefits
RRSP matching / Pension
+5
AI Engineer – Production LLM Systems & Agent Orchestration
AI Engineer – Production LLM Systems & Agent Orchestration

Indicium AI • Greater London

On-site
GBP 70,000 - 90,000
Highly competitive salary package
Company bonus
Personal learning budget
+1