Senior Data Engineer: Data Platform & Pipelines Lead

NewDay Technology; Greater London; Ibrido; GBP 90.000 - 120.000; Tempo pieno

Descrizione del lavoro

NewDay Technology in London is seeking a Senior Data Engineer to lead the design, build, and evolution of core data pipelines and platforms powering analytics, reporting, and data science across the business.

You will own ingestion and transformation pipelines using Spark, Python, SQL, AWS, DBT, and Snowflake, shape the Data Lake, drive CI/CD for cloud-native solutions, mentor engineers, and collaborate across teams in a hybrid working model.

Competenze

• DBT experience designing and improving data transformations in a complex environment.
• Proficiency in Python and SQL with ability to solve large-scale data problems.
• Experience with data modelling, ETL/ELT, data warehousing and scalable pipelines.
• Ability to design and guide modern data engineering solutions and lead other engineers.
• Interest in AI and automation to improve engineering quality and productivity.

Mansioni

• Lead development and optimisation of ingestion and transformation pipelines using Spark, Scala, Python, AWS, DBT and Snowflake.
• Architect and evolve the Data Lake to be robust, scalable, secure and future‑ready.
• Own ETL processing, table refreshes and BAU, driving automation to reduce manual work.
• Drive performance optimisation through concurrency, multi‑threading and best practices.
• Guide Agile delivery, mentor engineers, and ensure cloud‑native solutions are shipped via CI/CD.
• Integrate data from multiple sources and tackle advanced data challenges with strategic thinking.

Conoscenze

DBT

Python

SQL

Data modelling

ETL/ELT

Data warehousing

Pipelines

Leadership

AI & automation

Cloud platforms

Strumenti

Snowflake

Spark

Scala

Airflow

AWS

GitHub

CI/CD

Descrizione del lavoro

NewDay Technology in London is seeking a Senior Data Engineer to lead the design, build, and evolution of core data pipelines and platforms powering analytics, reporting, and data science across the business.

You will own ingestion and transformation pipelines using Spark, Python, SQL, AWS, DBT, and Snowflake, shape the Data Lake, drive CI/CD for cloud-native solutions, mentor engineers, and collaborate across teams in a hybrid working model.