Data Platform Engineering Manager

Pulse Group; Greater London; Hybrid; GBP 100,000 - 120,000; Full time

Benefits offered by this job

Annual bonus up to 20%

Hybrid working

Excellent benefits

Job summary

Pulse Group seeks an experienced Data Platform Engineering Manager to lead the development, management and optimisation of a large-scale cloud data platform supporting cyber security operations.

You will lead a team of Data Platform Engineers, drive architectural decisions and ensure scalability, security and reliability. Hybrid 2 days onsite / 3 days remote in London, with a competitive package and 20% bonus.

Qualifications

• Proven experience leading and developing Data Platform Engineering teams.
• Strong background designing and operating large-scale data platforms.
• Proficient in Python or Java and SQL for data processing.
• Experience with cloud platforms, especially Azure.
• Exposure to Spark, Flink and real-time/batch processing architectures.
• Hands-on with Kubernetes, Terraform and CI/CD pipelines.
• Knowledge of ETL/ELT, data lakes and Airflow orchestration.

Responsibilities

• Provide technical leadership and mentorship for the data platform team.
• Design and optimise scalable, secure data architectures.
• Oversee automated data ingestion and transformation frameworks.
• Lead cloud infrastructure, ensuring high availability and resilience.
• Drive DevOps practices, IaC, CI/CD and automation.
• Ensure data security, governance and regulatory compliance.
• Collaborate with cyber security, data, engineering and leadership teams.
• Support recruitment and engineering process improvements.

Skills

Python/Java

SQL

Kubernetes

Terraform

CI/CD

Airflow

Azure

Spark

Flink

Security analytics

Tools

Apache Airflow

Kubernetes

Terraform

CI/CD pipelines

Job description

Salary: Up to £120,000 + 20% Bonus + Excellent Benefits

Location: London, Farringdon

Working Pattern: Hybrid, 2 days onsite / 3 days remote

Employment Type: Permanent

Pulse Group are partnering with one of the UK's largest and most recognised retailers as they continue to invest in their Cyber Security and Data Engineering capabilities.

We are seeking an experienced Data Platform Engineering Manager to lead the development, management and optimisation of a large-scale cloud data platform supporting the organisation's cyber security operations.

This is a fantastic opportunity to take ownership of a business-critical platform that enables the acquisition, storage, processing and analysis of security data, supporting everything from real‑time threat detection and incident response to advanced analytics, Machine Learning and Generative AI.

You will lead a team of Data Platform Engineers, drive technical and architectural decisions, and ensure the platform remains scalable, secure, reliable and fit for future requirements.

Key Responsibilities

• Technical Leadership: Lead, mentor and develop a team of Data Platform Engineers, providing technical direction, supporting career development and driving engineering best practices.


• Data Platform Architecture: Design, develop and optimise scalable data architectures supporting real‑time, near‑real‑time and batch processing.


• Data Integration & Engineering: Oversee the development of automated data ingestion and transformation frameworks, integrating multiple security data sources into a centralised data lake.


• Cloud Infrastructure: Drive the development and management of cloud-based data infrastructure, ensuring high availability, scalability, performance and operational resilience.


• DevOps & Automation: Champion Infrastructure as Code, CI/CD and automation to improve platform reliability, deployment efficiency and engineering productivity.


• Data Security & Governance: Ensure robust security controls, data protection practices and regulatory compliance are embedded throughout the platform.


• Stakeholder Management: Collaborate with Cyber Security, Data, Engineering and senior leadership teams to align platform capabilities with business and security objectives.


• Team Growth: Support recruitment, talent development and the continuous improvement of engineering processes and standards.

We are looking for an experienced Engineering Manager with a strong technical foundation in Data Engineering and cloud-based platform development.

• Proven experience managing and developing Data Engineering or Data Platform Engineering teams.


• Strong background designing, building and operating large-scale, production-grade data platforms.


• Solid programming experience with Python or Java, alongside strong SQL proficiency.


• Experience with cloud platforms, ideally Microsoft Azure.


• Strong knowledge of big data processing technologies such as Apache Spark and Apache Flink.


• Hands‑on experience with Kubernetes, Terraform and CI/CD pipelines.


• Strong understanding of ETL/ELT frameworks, data lakes and workflow orchestration tools such as Apache Airflow.


• Experience designing and supporting real‑time, streaming and batch data processing architectures.


• Strong understanding of DevOps principles, infrastructure automation and engineering best practices.


• Demonstrable experience making architectural decisions, managing technical delivery and engaging with senior stakeholders.


• Excellent communication, leadership and problem‑solving skills.


• Knowledge of Cyber Security principles, security analytics or threat detection systems.


• Experience working with high‑volume security or operational data.


• Exposure to data platforms supporting Machine Learning, AI or Generative AI applications.


• Experience working within large-scale, complex or highly regulated enterprise environments.

What's on Offer?

Alongside a competitive salary of up to £120,000, the successful candidate will benefit from:

• Annual bonus of up to 20% of base salary.


• 25 days' annual leave, plus a personal day and bank holidays.


• Private medical insurance.


• Enhanced maternity, adoption and paternity leave.


• 24/7 virtual GP service and Employee Assistance Programme.


• Hybrid working, with just 2 days per week in the office.


• The opportunity to lead a high‑performing engineering team and influence the future direction of a business‑critical data platform.

Why Apply?

This is an excellent opportunity for an experienced Data Platform Engineering Manager who enjoys combining technical leadership with meaningful architectural ownership.

You'll be working at the intersection of Data Engineering, Cloud Infrastructure, Cyber Security and AI, helping shape the technology that enables advanced threat detection and data‑driven security operations at significant scale.

If you're passionate about building reliable, scalable data platforms and developing talented engineering teams, we'd love to hear from you.