Senior Data Engineer: Scalable Pipelines & Cloud Insights

LT Harper - Cyber Security Recruitment; England; On-site; GBP 55,000 - 75,000; Full time

Job summary

A leading recruitment agency is looking for a Senior Data Engineer to design and develop high-performance data solutions across various major cities in the UK. Candidates must have proven data engineering experience, strong skills in Scala and Python, and familiarity with big data frameworks like Databricks. This full-time role involves collaborating with technical teams to deliver scalable data solutions. Applicants must be UK residents, as no sponsorship is available.

Qualifications

• Proven experience leading data engineering or integration projects for enterprise clients.
• Deep technical expertise in Scala, Python, and big data frameworks.
• Strong understanding of data modelling, ETL design, and distributed systems.

Responsibilities

• Build and optimise data pipelines using modern technologies like Spark.
• Design and implement data models and entity resolution logic.
• Collaborate with architects and DevOps specialists to deliver data solutions.

Skills

Data engineering experience

Scala

Python

Databricks

Data modelling

ETL design

Distributed systems

Quantexa

Tools

Docker

Kubernetes

Jenkins

GitHub Actions

Azure DevOps

Job description

A leading recruitment agency is looking for a Senior Data Engineer to design and develop high-performance data solutions across various major cities in the UK. Candidates must have proven data engineering experience, strong skills in Scala and Python, and familiarity with big data frameworks like Databricks. This full-time role involves collaborating with technical teams to deliver scalable data solutions. Applicants must be UK residents, as no sponsorship is available.