Senior Data Engineer

Caspian One; Birmingham; On-site; GBP 90,000 - 120,000; Full time

Job summary

Caspian One is seeking a Senior Data Engineer to join its Cybersecurity Science & Analytics function in Birmingham. The role focuses on building cloud-native data pipelines, managing a data lake, and delivering scalable data assets to support security analytics.

You will collaborate with a global engineering team and contribute to automation, CI/CD, and platform resilience. The position requires experience with cloud platforms, data lake architectures, and ETL development, with a bonus for

Qualifications

• Experience with cloud-based data platforms and data lake architectures.
• Delivery of enterprise-grade ETL pipelines and data assets.
• Regulated industries knowledge is a plus; cybersecurity exposure beneficial.
• Experience in cybersecurity context is advantageous but not mandatory.
• Collaborative, global engineering environment with emphasis on learning and development.
• Exposure to cybersecurity, cloud platform engineering and advanced analytics.

Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.
• Ingest data from internal and external sources into enterprise data platforms.
• Create and maintain curated datasets and reusable data assets.
• Improve reliability, automation and operational resilience of data services.
• Support Azure cloud infrastructure and data platform operations.
• Work closely with engineering teams to onboard new data sources and define schemas.
• Contribute to exploratory data analysis and platform enhancement initiatives.
• Support real-time analytics and data availability improvements.

Skills

Cloud platforms

Data lake

ETL pipelines

Python scripting

CI/CD

Linux

Tools

Azure

Terraform

Unity Catalog

GitHub

SIEM/SOAR

Job description

A leading global financial services organisation is seeking a Senior Data Engineer to join its

Cybersecurity Science & Analytics function.

The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for

delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.

The role combines data engineering, cloud infrastructure, automation, platform operations and

production support responsibilities.

Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.
• Ingest data from internal and external sources into enterprise data platforms.
• Create and maintain curated datasets and reusable data assets.
• Improve reliability, automation and operational resilience of data services.
• Support Azure cloud infrastructure and data platform operations.
• Work closely with engineering teams to onboard new data sources and define schemas.
• Contribute to exploratory data analysis and platform enhancement initiatives.
• Support real-time analytics and data availability improvements.
• Strong Data Engineering experience.
• Enterprise ETL and data pipeline development.
• Python or equivalent scripting experience.
• GitHub and CI/CD practices.
• Linux administration and scripting.
• Infrastructure as Code, ideally Terraform.
• Unity Catalog
• SIEM and SOAR platforms

Experience

• Cloud-based data platforms
• Data lake architecture and delivery
• Regulated industries advantageous
• Cybersecurity experience beneficial but not essential
• Collaborative global engineering team
• Multi-disciplinary technology environment
• Strong learning and development culture
• Exposure to cybersecurity, cloud platform engineering and advanced analytics