Senior Data Engineer

LT Harper - Cyber Security Recruitment; Remote; GBP 90,000 - 110,000; Full time

Job summary

A UK-based technology recruitment agency is seeking a Senior Data Engineer to lead the design and development of high-performance data solutions. This role involves optimising data pipelines using technologies like Scala and Python while collaborating with various teams to produce scalable systems. The ideal candidate will have leading experience in data engineering projects, a strong technical foundation, and familiarity with data governance frameworks. Salary is competitive, ranging from £90k to £110k annually.

Qualifications

• Proven experience leading data engineering or integration projects for enterprise clients.
• Deep technical expertise in Scala, Python, and Databricks.
• Strong understanding of data modelling, ETL design, and distributed systems.

Responsibilities

• Build and optimise data pipelines using modern technologies.
• Design and implement data models and network-based insights.
• Collaborate with architects and DevOps to deliver cloud-native data solutions.

Skills

Data engineering leadership

Scala

Python

Databricks

Data modelling

ETL design

Distributed systems

Collaboration with DevOps

Tools

Spark

Quantexa

Docker

Kubernetes

Jenkins

Azure DevOps

Job description

The Role : Senior Data Engineer

Salary - £90k - £110k

Location - Various major Cities Across the UK - Must be UK resident - Sorry, No sponsorship

About the Role

As a Senior Data Engineer, you’ll lead the design and development of high-performance data solutions — from ingestion and transformation through to integration and insight. You’ll work directly with architects, engineers, and business stakeholders to turn ambitious ideas into scalable, production-ready systems.

Responsibilities

• Build and optimise data pipelines using modern technologies like Spark, Scala, and Python.
• Design and implement data models, entity resolution logic, and network-based insights.
• Collaborate with architects and DevOps specialists to deliver scalable, cloud-native data solutions.
• Translate complex business problems into efficient technical architectures.
• Work across data, cloud, and security teams to deliver seamless enterprise integration.

Required Skills

• Proven experience leading data engineering or integration projects for enterprise clients.
• Deep technical expertise in Scala, Python, and Databricks (or similar big data frameworks).
• Strong understanding of data modelling, ETL design, and distributed systems.
• Experience with data tools such as Quantexa is a must.

Preferred Skills

• Experience with Financial Services, Fraud Detection, AML, or KYC solutions.
• Familiarity with DevOps pipelines (Jenkins, GitHub Actions, Azure DevOps).
• Hands-on knowledge of Docker, Kubernetes, and data governance frameworks.

For more information, apply here or email me at [e-mail].