Senior Core Data Engineer - Pipelines & Quality

Flow Traders; Greater London; Hybrid; GBP 85,000 - 120,000; Full time

Benefits offered by this job

Flow Academy

Catered lunch

On-site gym

Massages

Company trips

Global rotations

Job summary

Flow Traders is seeking a Core Data Engineer to own end-to-end data product lifecycles, including Security Master, ETF compositions, high‑resolution histories, and trades records. You will design and monitor automated pipelines so users across the firm have reliable data when needed.

You will collaborate with teams to optimize data sources, ensure data quality in production, and scale data platforms to support quantitative trading growth.

Qualifications

• Analytics or data engineering experience in a high-growth setting.
• Strong data modelling and data quality practice with contracts and lineage.
• Proficient in Python and SQL with production experience.
• Experience with large datasets and modern cloud data stacks.

Responsibilities

• Own end-to-end lifecycle of core data products and pipelines.
• Develop quality checks and automate data processing steps.
• Ensure data quality and establish robust monitoring and alerts.
• Build foundations: reference data, instrument identifiers, feeds.
• Maintain high availability across time zones for critical pipelines.

Skills

Data engineering

Data modelling

Python

SQL

Big data

Production ownership

Stakeholder collaboration

5+ years

Tools

Airflow

Kafka

GCP (GKE, Dataproc, BigQuery)

Spark/Databricks

dbt

Polars

Pandas

NiFi

Job description

Flow Traders is seeking a Core Data Engineer to own end-to-end data product lifecycles, including Security Master, ETF compositions, high‑resolution histories, and trades records. You will design and monitor automated pipelines so users across the firm have reliable data when needed.

You will collaborate with teams to optimize data sources, ensure data quality in production, and scale data platforms to support quantitative trading growth.