AI Data Quality Specialist for RL & Evaluation

QuantumLight

United Kingdom

On-site

GBP 60,000 - 100,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

QuantumLight Capital is seeking a Data Quality Specialist to enhance data quality and evaluation environments for AI systems. You will design validation mechanisms, build reliable datasets and support RL environment development, collaborating with Data and Investment Teams to ensure outputs are accurate and consistent.

The role emphasizes Python and SQL proficiency, experience with large datasets, data validation, and regression testing, plus familiarity with agent-based systems or RL frameworks.

Qualifications

  • 3-4 years of experience in data quality or related field.
  • Strong proficiency in Python and SQL.
  • Experience with large datasets and automated testing.
  • Understanding of AI/ML concepts and evaluating model outputs or AI system performance.
  • Familiarity with agent-based systems, evaluation frameworks or reinforcement learning environments.
  • Experience with Git and version control.
  • Analytical mindset with exceptional attention to detail.

Responsibilities

  • Data Quality and Validation: Build and maintain data validation processes to ensure the accuracy, completeness and consistency of large datasets.
  • Agent Evaluation: Develop evaluation datasets, test cases and quality checks to assess AI agent performance, identify failure modes and improve reliability.
  • RL Environments: Support the creation and maintenance of structured environments for reinforcement learning, including scenarios, test cases and feedback mechanisms.
  • Anomaly Detection: Identify inconsistencies, conflicting information and unexpected model or data behaviour, investigating root causes and implementing fixes.
  • Data Pipelines and Tooling: Use SQL and Python to build validation scripts, automate quality checks and improve data processing and evaluation workflows.
  • Cross-functional Collaboration: Work with Data and Investment Teams to translate business requirements into reliable datasets, evaluation criteria and testing frameworks.

Skills

Python
SQL
Data quality
Data analysis
Data engineering
Git

Tools

Spark

Job description

QuantumLight Capital is seeking a Data Quality Specialist to enhance data quality and evaluation environments for AI systems. You will design validation mechanisms, build reliable datasets and support RL environment development, collaborating with Data and Investment Teams to ensure outputs are accurate and consistent.

The role emphasizes Python and SQL proficiency, experience with large datasets, data validation, and regression testing, plus familiarity with agent-based systems or RL frameworks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Data Quality Engineer for RL & Evaluation
AI Data Quality Engineer for RL & Evaluation

QuantumLight • Greater London

On-site
GBP 55,000 - 75,000
Data Quality Engineer
Data Quality Engineer

QuantumLight • Greater London

On-site
GBP 55,000 - 75,000
RL Environment Data Engineer / Researcher
RL Environment Data Engineer / Researcher

Eigent AI • Greater London

Hybrid
GBP 65,000 - 85,000
Scalable AI Data Engineer
Scalable AI Data Engineer

QuantumBlack, AI by McKinsey • Greater London

On-site
GBP 60,000 - 90,000
AI-Driven Quant Data Engineer
AI-Driven Quant Data Engineer

Barlowe LLP • Greater London

On-site
GBP 80,000 - 120,000
Lunch provided
35 days annual leave
9% company pension contributions
+5
RL Environment Architect & Data Research Engineer
RL Environment Architect & Data Research Engineer

Eigent AI • Greater London

Hybrid
GBP 65,000 - 85,000
Lead AI Quant Researcher for VC Trading
Lead AI Quant Researcher for VC Trading

QuantumLight • United Kingdom

On-site
GBP 90,000 - 160,000
Data Analyst: AI Agent Search Quality & Evaluations
Data Analyst: AI Agent Search Quality & Evaluations

Nebius Group • Greater London

On-site
GBP 45,000 - 70,000
Competitive compensation
Career growth
Flexibility and ownership
+4
Lead AI Quant Researcher - Build Production Trading Signals
Lead AI Quant Researcher - Build Production Trading Signals

QuantumLight • Greater London

On-site
GBP 110,000 - 150,000
AI Agent Quality Scientist
AI Agent Quality Scientist

Lovable • Greater London

Hybrid
GBP 90,000 - 130,000