Senior Data Engineer | London, UK | Hybrid

McGregor Boyall; London; Hybrid; GBP 70,000 - 95,000; Full time

Job summary

A global financial services firm is seeking a Senior Data Engineer to enhance their data pipelines for its brokerage technology team. The ideal candidate will have robust skills in Python and SQL, with experience in Airflow and handling complex datasets. This role is hybrid, requiring some office presence in London, and offers a competitive salary up to £95,000 plus benefits.

Qualifications

• Strong skills in Python and SQL are essential.
• Experience with Airflow, ideally MWAA.
• Experience in finance or high-volume, regulated industries is preferred.

Responsibilities

• Design and build robust ETL pipelines using Python and AWS services.
• Own and maintain Airflow workflows.
• Ensure high data quality through rigorous testing.

Skills

Strong Python skills

Strong SQL skills

Hands-on experience with Airflow

Background working with large, complex datasets

Attention to detail

Tools

Python

SQL/PLSQL (MS SQL + Oracle)

Apache Airflow (MWAA)

AWS Glue

Git

JIRA

Job description

Senior Data Engineer

McGregor Boyall London, United Kingdom Apply now Posted 4 days ago Hybrid Job Permanent GBP7000.00 - GBP95000.00 per annum

Senior Data Engineer

McGregor Boyall London, United Kingdom Apply now

Senior Data Engineer
Up to £95,000 + benefits | Hybrid (3 days a week in City of London)

A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team.

You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements.

This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability.

Key responsibilities

Design and build robust ETL pipelines using Python and AWS services

Own and maintain Airflow workflows

Ensure high data quality through rigorous testing and validation

Analyse and understand complex data sets before pipeline design

Collaborate with stakeholders to translate business requirements into data solutions

Monitor and improve pipeline performance and reliability

Maintain documentation of systems, workflows, and configs

Tech environment

Python, SQL/PLSQL (MS SQL + Oracle), PySpark

Apache Airflow (MWAA), AWS Glue, Athena

AWS services (CDK, S3, data lake architectures)

Git, JIRA

You should apply if you have:

Strong Python and SQL skills

Hands-on experience with Airflow (ideally MWAA)

Background working with large, complex datasets

Experience in finance or similar high-volume, regulated industries (preferred but not essential)

High attention to detail and a clear commitment to data quality

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

McGregor Boyall is a privately owned global recruitment consultancy founded in 1987. We are headquartered in the City of London, with additional offic...

Software Engineer Java AVP FX E-Trading McGregor Boyall London, United Kingdom

Lead Product Owner (Data) McGregor Boyall London, United Kingdom

Project Manager McGregor Boyall London, United Kingdom

UK Technology CIO McGregor Boyall London, United Kingdom

QA Automation Lead - Fintech McGregor Boyall London, United Kingdom

C++ Developer McGregor Boyall London, United Kingdom

Lead Engineer - Insurance FinTech Scale-up McGregor Boyall London, United Kingdom

C++ Developer McGregor Boyall Hong Kong

FICC BA/PM McGregor Boyall London, United Kingdom

More jobs from the company

Boost your career

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.