Senior Data Engineer: Build scalable data pipelines

LT Harper - Cyber Security Recruitment; Remote; GBP 90,000 - 105,000; Full time

Job summary

A prominent recruitment firm is seeking a Senior Data Engineer to lead the design and development of high-performance data solutions in the UK. The ideal candidate will possess strong expertise in Scala, Python, and data tools like Quantexa. Responsibilities include building and optimizing data pipelines, ensuring seamless integration, and translating complex business problems into efficient architectures. This role offers a competitive salary range of £90k - £105k, and is suitable for UK residents only.

Qualifications

• Proven experience leading data engineering or integration projects for enterprise clients.
• Deep technical expertise in Scala, Python, and Databricks (or similar big data frameworks).
• Strong understanding of distributed systems.

Responsibilities

• Build and optimise data pipelines using modern technologies.
• Design and implement data models and entity resolution logic.
• Collaborate with architects and DevOps specialists to deliver scalable, cloud-native data solutions.

Skills

Spark

Scala

Python

Data modelling

ETL design

Data integration

Quantexa

Education

Degree in Computer Science, Data Engineering, or a related technical field

Tools

Databricks

Docker

Kubernetes

Jenkins

GitHub Actions

Azure DevOps

Job description

A prominent recruitment firm is seeking a Senior Data Engineer to lead the design and development of high-performance data solutions in the UK. The ideal candidate will possess strong expertise in Scala, Python, and data tools like Quantexa. Responsibilities include building and optimizing data pipelines, ensuring seamless integration, and translating complex business problems into efficient architectures. This role offers a competitive salary range of £90k - £105k, and is suitable for UK residents only.