Senior Data Engineer: Pipelines, Airflow & Databricks

Marks and Spencer; City Of London; Hybrid; GBP 75,000 - 100,000; Full time

Benefits offered by this job

20% colleague discount

Holiday entitlement

Discretionary bonus

Defined Contribution Pension

Life Assurance

Wellbeing & training programmes

Team induction & development

M&S Choices discounts

Parental/adoption policies

Job summary

Marks & Spencer is seeking an experienced Full Stack Data Engineer to join our Customer Data Science team. You will design, build and maintain robust data pipelines, orchestration with Airflow, and Databricks-based solutions to empower data scientists with reliable data foundations and scalable platforms.

You will collaborate across product and delivery partners, contribute to engineering standards, and promote sustainable, observable data engineering practices in a hybrid UK-based role.

Qualifications

• Strong data engineering experience with the ability to work independently, take ownership and deliver outcomes.
• Experience supporting data science workflows and partnering closely with data scientists to enable successful delivery.
• Clear and effective communicator who collaborates well across teams.
• Proactive problem solver focusing on root-cause analysis and practical solutions.
• Adaptable and curious, with learning mindset; exposure to MLOps concepts is a plus.

Responsibilities

• Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases.
• Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable.
• Work hands-on with Databricks suite to deliver high-quality data engineering solutions for data science teams.
• Contribute to collaborative development through GitHub, code reviews and shared engineering standards.
• Work effectively in feature-led environments, supporting repeatable, controlled and high-quality delivery.

Skills

Data engineering

Independent delivery

Collaborative work

Communication

Tools

Airflow

Databricks

GitHub

Job description

Marks & Spencer is seeking an experienced Full Stack Data Engineer to join our Customer Data Science team. You will design, build and maintain robust data pipelines, orchestration with Airflow, and Databricks-based solutions to empower data scientists with reliable data foundations and scalable platforms.

You will collaborate across product and delivery partners, contribute to engineering standards, and promote sustainable, observable data engineering practices in a hybrid UK-based role.