Cyber Data Platform Engineering Lead

Tesco Technology; Welwyn Garden City; Hybrid; GBP 90,000 - 140,000; Full time

Benefits offered by this job

Annual bonus up to 20%

25 days holiday + personal day

Private medical insurance

Maternity/Adoption leave

Paternity leave

24/7 virtual GP & EAP

Job summary

Tesco Technology is seeking a Data Platform Engineering Manager in the cyber data team to lead a group of engineers building a reliable data platform for acquisition, storage, processing and analysis of security data. You will design realtime, near realtime, and batch data architectures, drive DevOps practices, and oversee data security, compliance, and automation.

The role also involves mentoring talent and collaborating with security leadership.

Qualifications

• Proven experience leading data platform teams at scale.
• Strong programming experience with Python or Java and SQL.
• Experience with cloud platforms (Azure) and big data tools (Spark, Flink).
• Solid knowledge of Kubernetes, CI/CD and Terraform.
• Familiarity with ETL/ELT and orchestration tools like Airflow.

Responsibilities

• Design, build and manage realtime, near realtime and batch data architectures for threat detection and analytics.
• Implement and manage automated data integration from various security sources into a security lake.
• Enforce data security standards and regulatory compliance.
• Drive automation and DevOps practices to streamline deployment and management of data platform components.
• Support recruitment, talent development, reporting to leadership, and management of external providers.

Skills

Python

Java

SQL

Kubernetes

CI/CD

Terraform

Airflow

Azure

Tools

Spark

Flink

Airflow

Job description

Tesco Technology is seeking a Data Platform Engineering Manager in the cyber data team to lead a group of engineers building a reliable data platform for acquisition, storage, processing and analysis of security data. You will design realtime, near realtime, and batch data architectures, drive DevOps practices, and oversee data security, compliance, and automation.

The role also involves mentoring talent and collaborating with security leadership.