Data Platform Engineer - Cyber Data Platform

Tesco UK; City Of London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading retail company in London seeks a Data Platform Engineer to enhance their data platform supporting advanced analytics and cybersecurity initiatives. You will design data architectures, integrate data securely, and ensure high-quality coding practices. The role offers a flexible working model, where you'll balance in-office collaboration and remote work.

Qualifications

• Proficiency in SQL and programming languages like Python.
• Working knowledge of ETL and ELT frameworks and orchestration tools.
• Experience working with cloud platforms such as Azure.

Responsibilities

• Support the design, build and management of data architectures for threat detection.
• Implement automated frameworks for data integration into the security data lake.
• Contribute to high-quality code and documentation of data platform architecture.
• Implement automations and DevOps practices to manage platform components.
• Collaborate with team members on issues related to data platform operations.

Skills

Proficiency in SQL

Python programming

ETL and ELT frameworks

Orchestration tools like Airflow

Cloud platforms (e.g., Azure)

Data lakes and data warehouses concepts

Distributed systems (Kafka, Spark)

Kubernetes

CI/CD

Terraform

Cybersecurity principles and practices

Job description

As the Data Platform Engineer in the Cyber Data Platform team, you will contribute to the development and maintenance of a robust data platform that enables users to develop advanced analytics, machine learning, and GenAI solutions to strengthen our security defences. You will collaborate closely with cross functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals.

Responsibilities

• Data Architecture: Support the design, build and management of realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.
• Data Integration and Transformation: Implement and manage the automated frameworks for integrating the data from various security sources into the security data lake. Also, the data transformation frameworks to move data between the raw, trusted, and curated data layers.
• Coding and Documentations: Contribute to raising the quality bar of the team's codebase by producing high-quality code and documentation of data platform architecture, process and best practices.
• Automation and DevOps: Implement various automations and DevOps practices to streamline the deployment, configuration, and management of data platform components.
• Collaboration and Communication: Collaborate and communicate effectively with members of the team and actively participate in resolving issues related to data platform operations, providing support as needed.

Qualifications

• Proficiency in SQL and programming languages like Python
• Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbt
• Experience working with cloud platforms e.g. Azure
• Knowledge of data lakes and data warehouses concepts and distributed systems like Kafka, Spark etc.
• Familiarity of Kubernetes, CI/CD and Terraform
• Knowledge of cybersecurity principles and practices

Flexible Working

At Tesco, we champion a balance that lets you thrive both in and out of work. Spend 60% of your week collaborating with colleagues at our office locations or local sites and the rest remotely. Whether you're just kicking off your career, juggling passions, or navigating big life events, we're here to support you. We always welcome a conversation about flexible working, so talk to us throughout your application about how we can support.

Disability Inclusive Support

We're proud to be an accredited Disability Confident Leader, where everyone’s welcome. That’s why we commit to providing a fully inclusive and accessible recruitment process. If you need support with your application, click here for more information. And if you're interested in joining our team but don't tick every box, don't let that hold you back from applying.