Senior Data Engineer - Cloud Data Lake Analytics

Caspian One; Birmingham; On-site; GBP 90,000 - 120,000; Full time

Job summary

Caspian One is seeking a Senior Data Engineer to join its Cybersecurity Science & Analytics function in Birmingham. The role focuses on building cloud-native data pipelines, managing a data lake, and delivering scalable data assets to support security analytics.

You will collaborate with a global engineering team and contribute to automation, CI/CD, and platform resilience. The position requires experience with cloud platforms, data lake architectures, and ETL development, with a bonus for

Qualifications

• Experience with cloud-based data platforms and data lake architectures.
• Delivery of enterprise-grade ETL pipelines and data assets.
• Regulated industries knowledge is a plus; cybersecurity exposure beneficial.
• Experience in cybersecurity context is advantageous but not mandatory.
• Collaborative, global engineering environment with emphasis on learning and development.
• Exposure to cybersecurity, cloud platform engineering and advanced analytics.

Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.
• Ingest data from internal and external sources into enterprise data platforms.
• Create and maintain curated datasets and reusable data assets.
• Improve reliability, automation and operational resilience of data services.
• Support Azure cloud infrastructure and data platform operations.
• Work closely with engineering teams to onboard new data sources and define schemas.
• Contribute to exploratory data analysis and platform enhancement initiatives.
• Support real-time analytics and data availability improvements.

Skills

Cloud platforms

Data lake

ETL pipelines

Python scripting

CI/CD

Linux

Tools

Azure

Terraform

Unity Catalog

GitHub

SIEM/SOAR

Job description

Caspian One is seeking a Senior Data Engineer to join its Cybersecurity Science & Analytics function in Birmingham. The role focuses on building cloud-native data pipelines, managing a data lake, and delivering scalable data assets to support security analytics.

You will collaborate with a global engineering team and contribute to automation, CI/CD, and platform resilience. The position requires experience with cloud platforms, data lake architectures, and ETL development, with a bonus for