Senior Data Engineer - Hybrid Cloud Pipelines

NewDay Cards Limited; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

NewDay is looking for a Senior Data Engineer to lead design, build, and evolution of core pipelines powering analytics and data science across our business. You’ll shape ingestion/transformation pipelines with Spark, Python, AWS, DBT, and Snowflake, while guiding data engineering standards and governance.

You will mentor engineers, drive CI/CD for cloud-native solutions, and evolve our Data Lake to be robust, scalable, and future-ready. Hybrid London-based role.

Qualifications

• Hands-on experience using DBT to design, build and improve data transformations within a complex data environment.
• Engineering experience using Python and SQL, with the ability to solve complex data problems at scale.
• The ability to design and guide modern data engineering solutions, with knowledge of data modelling, ETL/ELT, data warehousing and scalable data pipelines.
• The ability to lead and develop Data Engineers, combining hands-on technical contribution with coaching, technical direction and ownership of delivery.
• An interest in AI and automation, with the technical curiosity to explore how emerging technologies could improve engineering quality, productivity and ways of working.

Responsibilities

• Leading the development and optimisation of ingestion and transformation pipelines using Spark, Scala, Python, AWS, DBT, and Snowflake.
• Architecting and evolving the Data Lake environment to be robust, scalable, secure, and future-ready.
• Owning and improving ETL processing, table refreshes, defect resolution, and automation to reduce manual effort.
• Championing performance optimisation through concurrency, multi-threading, automation, and best-practice engineering patterns.
• Guiding Agile delivery, mentoring engineers, and ensuring high-quality, cloud-native data solutions are shipped via CI/CD.
• Integrating data from multiple sources and solving sophisticated data challenges with creativity, technical depth, and strategic thinking.
• Influencing data engineering standards, patterns, and governance across the wider organisation.

Skills

Python

SQL

Spark

Data modelling

ETL/ELT design

CI/CD

Leadership

Agile

AI interest

Tools

DBT

Snowflake

AWS

GIT/GitHub

Airflow

Job description

NewDay is looking for a Senior Data Engineer to lead design, build, and evolution of core pipelines powering analytics and data science across our business. You’ll shape ingestion/transformation pipelines with Spark, Python, AWS, DBT, and Snowflake, while guiding data engineering standards and governance.

You will mentor engineers, drive CI/CD for cloud-native solutions, and evolve our Data Lake to be robust, scalable, and future-ready. Hybrid London-based role.