Platform Data Engineer

ASDA; Leeds; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A leading retail company in the UK is seeking a Platform Data Engineer to join their Platform Engineering team. This role involves designing and optimising data frameworks in Databricks as well as ensuring scalability and reliability of pipelines. Candidates should have strong skills in Python and SQL, along with a collaborative spirit. The position offers a competitive salary and an excellent benefits package, with a hybrid work model requiring at least three days in the office.

Benefits

Discretionary company bonus

Company pension up to 7% matched

15% colleague discount

Free access to wellbeing services

Excellent parental leave policies

Qualifications

• Proven experience building and supporting data pipelines and frameworks.
• Strong proficiency in Python, SQL, and PySpark.
• Hands-on experience with Databricks and Azure Data Factory.

Responsibilities

• Design, build, and optimise platform-level data frameworks in Databricks.
• Develop shared capabilities for domain squads to self-serve.
• Engineer for scale and reliability ensuring performance and compliance.

Skills

Python

SQL

PySpark

Databricks

Azure Data Factory

Event Hubs

Azure Data Lake Storage (ADLS)

CI/CD

Agile methodologies

Monitoring and observability tooling

Job description

Job Title

Platform Data Engineer

Location

Asda House

Employment Type

Full time

Contract Type

Permanent

Hours Per Week

37.5

Salary

Competitive salary plus benefits.

Category

Data Science

Closing Date

8 November 2025

This role requires on-site presence at Asda House in Leeds for at least three days per week. We’re really looking forward to having you around!

We’re looking for a Platform Data Engineer to join our Platform Engineering team within the wider Data function.

In this role, you’ll help build, evolve, and support the shared data platform capabilities that power Asda’s analytical, operational, and streaming data products.

You’ll work closely with Data Engineers, Architects, and Product Managers across the data ecosystem to deliver scalable, secure, and cost efficient platform services enabling domain squads to deliver faster, more reliably, and with stronger observability.

You’ll also contribute to our engineering community of practice, driving continuous improvement, reusability, and high standards across everything we deliver.

Your Role (Key Responsibilities)

• Design, build, and optimise platform-level data frameworks and pipelines in Databricks and Azure that underpin ingestion, transformation, and governance at scale.
• Develop shared capabilities (e.g. ingestion framework, metadata capture, monitoring, FinOps dashboards, and operational observability tooling) that enable domain squads to self-serve.
• Engineer for scale and reliability ensuring all pipelines and services are performant, cost‑efficient, observable, and compliant with platform security and governance standards.
• Automate platform operations, reducing manual intervention through CI/CD, templated deployments, and reusable patterns.
• Collaborate cross-functionally with Domain Data Engineers, Architects, and Platform Services (Infrastructure, Security, Power Platform) to ensure consistent design, performance, and integration across the ecosystem.
• Contribute to cost observability and FinOps initiatives, instrumenting metrics at workspace, pipeline, and workload levels to drive optimisation and accountability.
• Champion engineering best practices, including version control, code review, testing, observability, and documentation as part of our Agile Community of Practice.
• Support platform reliability through proactive monitoring, alerting, and incident analysis across production and non-core environments.
• Participate actively in Agile ceremonies, retrospectives, and technical design sessions to continuously improve our engineering culture and delivery processes.

About You (Experience & Qualifications)

• Proven experience building and supporting data pipelines and frameworks at platform or enterprise scale.
• Strong proficiency in Python, SQL, and PySpark, with a focus on performance, scalability, and modular design.
• Hands‑on experience with Databricks, Azure Data Factory, Event Hubs, and Azure Data Lake Storage (ADLS).
• Experience with streaming and batch architectures, including Delta Live Tables and Medallion design patterns.
• Understanding of data governance, security, and access control including Unity Catalog, CMK encryption, Key Vault, and service principal management.
• Familiarity with monitoring and observability tooling (e.g. logging, metrics, dashboards, alerts) and how to embed these into engineering solutions.
• Experience contributing to CI/CD pipelines, infrastructure‑as‑code, and GitHub‑based workflows.
• Understanding of FinOps principles and how to engineer for cost transparency and efficiency.
• Strong collaborator with excellent communication skills, a problem‑solving mindset, and an eagerness to simplify, automate, and enable others.
• Experience working within Agile delivery frameworks (Scrum, Kanban, or Lean) in a multi‑squad data organisation.

This position is open to flexible working / job share / part time working.

If you have any questions about the role, then please email [e-mail]

Everything you'll love

To ensure we balance moments where we know we need to collaborate together and the need for flexibility, Asda has a hybrid way of working with a minimum 3 days a week in one of our Home Offices. Over and above this, each area of Asda may have additional requirements which may require spending more days in the office, visiting suppliers, stores or depots.

You will also get an excellent benefits package including:

• Discretionary company bonus
• Company pension up to 7% matched
• 15% colleague discount in store and online
• Free access to wellbeing services such as Wagestream, 24/7 virtual GP, counselling, health and dental cash plans and a 24/7 employee assistance helpline, alongside discounts across a range of services and activities, from airport parking, enhanced to theme parks and cinemas.
• Asda Allies Inclusion Networks – helping colleagues to make sure everybody is included and that our differences are recognised and celebrated
• Excellent parental leave policies, including maternity & adoption leave, paternity leave, shared parental leave, neonatal care leave, and support for those doing fertility treatments.

We want all colleagues to be able to bring their best and true selves to work, every day. Simply put, we want our colleagues to be Proud to be Asda and proud to be themselves