Staff Data Engineer: Lead Cloud Data Platform & Pipelines

Marks & Spencer Group; City of Westminster; Hybrid; GBP 85,000 - 115,000; Full time

Benefits offered by this job

Employee discount

Pension scheme

Wellbeing support

Training & development

Job summary

Marks & Spencer Group is seeking a Staff Data Engineer to design, build and maintain scalable data pipelines in the BEAM Cloud Data Platform. You will lead a small squad, own complex tasks, and drive the adoption of standard data frameworks across the organisation.

You will collaborate with Product and Delivery teams to deliver robust data solutions, advocate best practices, and help democratise data for customers and colleagues.

Qualifications

• Proven leadership mindset and business acumen.
• Expertise in cloud-based data technologies and data warehousing design, preferably Azure.
• Experience building end-to-end data solutions.
• Experience with ETL tools, e.g. Databricks, SQL.
• Proficient in Python, SQL and Spark.

Responsibilities

• Design, build and maintain high-quality, reliable data solutions and own it with a high degree of automation in the cloud.
• Provide technical leadership to a small squad of engineers.
• Own complex tasks in the backlog and deliver them routinely with no significant issues.
• Lead in the development of M&S standard data frameworks and policies, ensuring that they are understood and adopted.
• Support other data engineers to produce clean, quality code through code reviews and pair programming.
• Design, develop, and maintain scalable data pipelines that adhere to ETL principles and business goals.

Skills

Leadership

Cloud data tech

Data warehousing design

End-to-end data solutions

ETL tools

Python

SQL

Spark

Tools

Databricks

SQL

Python

Spark

Job description

Marks & Spencer Group is seeking a Staff Data Engineer to design, build and maintain scalable data pipelines in the BEAM Cloud Data Platform. You will lead a small squad, own complex tasks, and drive the adoption of standard data frameworks across the organisation.

You will collaborate with Product and Delivery teams to deliver robust data solutions, advocate best practices, and help democratise data for customers and colleagues.