Payments AI Data Platform Lead

RedCompass Labs; Manchester; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Bonus up to 10%

Life Insurance

Income Protection

Health Insurance

Dental Insurance

Pension Plan

28 days holiday

Sick leave

Job summary

RedCompass Labs in Manchester is seeking an AI Data Platform Lead to own the data foundation behind our Payments Expert Agent. You will report to the Head of AI Engineering and line-manage our DevOps/Platform engineers, operating in a regulated environment where data quality is the product.

You will own ETL pipelines, real-time data flows, benchmarking, and deployment strategies for internal LLMs, with a highly collaborative, globally distributed team.

Qualifications

• Track record owning production data platforms at scale (ETL/ELT).
• Experience in financial services or regulated data sources.
• Experience with RAG and knowledge retrieval systems; measurement and improvement.
• Hands-on with LLM evaluation, eval harnesses and regression testing of non-deterministic systems.
• Proficient in Python; comfortable in an Azure-native environment.

Responsibilities

• Own the ETL data platform and knowledgebase ingestion, transformation, refresh and quality.
• Ensure steady flow of accurate, real-time data into knowledge stores.
• Own AI agent and knowledge benchmarking; define strategy and build implementation.
• Develop infrastructure strategy and implementation for AI product deployment.
• Develop observability of AI agent and knowledge usage; define strategy and implementation.
• Own strategy to productionise internally trained LLMs; move models from research into deployment.
• Lead our SRE and Observability team.

Skills

Production data platforms

Financial services

RAG & retrieval systems

LLM evaluation

Python

Azure-native

Technical strategy

DevOps leadership

Tools

Azure Data Factory

Azure Functions

Azure Storage

Orchestration tooling

Docker

GitHub Actions

Azure DevOps

Job description

RedCompass Labs in Manchester is seeking an AI Data Platform Lead to own the data foundation behind our Payments Expert Agent. You will report to the Head of AI Engineering and line-manage our DevOps/Platform engineers, operating in a regulated environment where data quality is the product.

You will own ETL pipelines, real-time data flows, benchmarking, and deployment strategies for internal LLMs, with a highly collaborative, globally distributed team.