Senior Data Engineer

Caspian One; Sheffield; Hybrid; GBP 70,000 - 95,000; Full time

Job summary

Caspian One in the United Kingdom is seeking an experienced Senior Data Engineer to join its Cybersecurity Science & Analytics team, delivering robust data pipelines, scalable analytics and security-focused data platforms in a global financial services context.

This hybrid role spans Sheffield or Birmingham, working on Azure-based data lakes, ETL workflows, data modelling and platform operations, with production support and collaboration across engineering, analytics and cybersecurity teams.

Qualifications

• Experience delivering data pipelines in large-scale enterprises.
• Strong Azure data services, ETL development and data modelling.
• Ability to automate and optimize data platforms.
• Familiarity with cybersecurity analytics is a plus.

Responsibilities

• Design, build and optimise cloud-based data pipelines and ETL workflows.
• Integrate and manage data from multiple internal and external sources.
• Develop and maintain raw, enriched and curated datasets for cybersecurity analytics use cases.
• Improve data quality, pipeline reliability, automation and platform scalability.
• Enhance real-time data ingestion and processing capabilities.
• Support cloud infrastructure, platform operations and production services within Azure.
• Collaborate with senior engineering stakeholders to onboard new data sources and define schemas.
• Contribute to the evolution of a strategic cybersecurity data platform.

Skills

Data engineering

Azure

ETL development

Data modelling

Cloud infrastructure

Production support

Tools

Azure Data Factory

Azure Synapse

Azure Data Lake

Job description

Location: Sheffield or Birmingham (Hybrid)

Function: Cybersecurity Science & Analytics

The Opportunity

An exciting opportunity has arisen for an experienced Senior Data Engineer to join a leading global financial services organisation's Cybersecurity Science & Analytics team.

This specialist function combines data engineering, advanced analytics, AI/ML and cybersecurity expertise to build innovative security capabilities across one of the world's largest technology environments. You'll play a key role in developing and enhancing a strategic cybersecurity data lake and analytics platform that supports critical security operations at scale.

The Role

As a Senior Data Engineer, you will be a hands-on contributor within the Platform & Data Engineering team, responsible for delivering robust, scalable and secure data engineering solutions. The position offers exposure across data engineering, cloud infrastructure, platform operations and production support in a modern Azure-based environment.

Key Responsibilities

• Design, build and optimise cloud-based data pipelines and ETL workflows.
• Integrate and manage data from a variety of internal and external sources.
• Develop and maintain raw, enriched and curated datasets for cybersecurity analytics use cases.
• Improve data quality, pipeline reliability, automation and platform scalability.
• Enhance real-time data ingestion and processing capabilities.
• Support cloud infrastructure, platform operations and production services within Azure.
• Collaborate with senior engineering stakeholders to onboard new data sources, define schemas and perform exploratory data analysis.
• Contribute to the ongoing evolution of a strategic cybersecurity data platform.

What We're Looking For

• Strong experience in data engineering within large-scale enterprise environments.
• Expertise in building and maintaining cloud-native data pipelines.
• Experience working with Azure data services and cloud infrastructure.
• Knowledge of ETL development, data modelling and data platform operations.
• Strong problem-solving skills with a focus on automation and optimisation.
• Ability to work collaboratively across engineering, analytics and cybersecurity teams.
• Experience supporting production environments and operational platforms.

Why Apply?

This is a unique opportunity to help shape next-generation cybersecurity data and analytics capabilities on a global scale. You'll work with cutting-edge Azure, big data and automation technologies while developing expertise across multiple disciplines, including:

• Site Reliability Engineering (SRE)
• Cybersecurity Analytics

For ambitious engineers looking to broaden their technical exposure and make a tangible impact within a large-scale cybersecurity environment, this role offers both challenge and long-term career growth.