Senior Data Engineer: Databricks Lakehouse Lead

Primark; Reading; On-site; GBP 70,000 - 105,000; Full time

Job summary

Primark is seeking a Senior Data Engineer to join the Data Platform & Engineering team. You will lead the design and delivery of scalable data solutions on the Databricks platform, building trusted data products for reporting, analytics, AI and data science.

You’ll mentor engineers, drive best practices, and play a key role in migrating from Teradata to Databricks while advancing our data & analytics capabilities across the business.

Qualifications

• 5–8 years of advanced data engineering experience.
• Experience designing and delivering enterprise data pipelines.
• Proficient in lakehouse architectures, data models and SQL.
• Familiarity with Databricks pipelines, ETL/ELT and data testing.

Responsibilities

• Design, build and optimise scalable data pipelines using Databricks, PySpark and SQL.
• Develop and maintain lakehouse architectures and reusable data models.
• Lead engineering initiatives and promote CI/CD, testing and documentation.
• Mentor Data Engineers and drive engineering best practices.
• Support migration from Teradata to Databricks and platform evolution.

Skills

Databricks

PySpark

SQL

CI/CD

Data modeling

Education

Bachelor's degree in CS or related

Tools

dbt Cloud

dbt Core

Azure

Spark

Job description

Primark is seeking a Senior Data Engineer to join the Data Platform & Engineering team. You will lead the design and delivery of scalable data solutions on the Databricks platform, building trusted data products for reporting, analytics, AI and data science.

You’ll mentor engineers, drive best practices, and play a key role in migrating from Teradata to Databricks while advancing our data & analytics capabilities across the business.