Data engineer in analytics platforms

Newday; Greater London; Presencial; GBP 80.000 - 110.000; Tempo integral

Resumo da vaga

NewDay в Лондоне ищет инженера данных, который сможет проектировать, строить и развивать ядро конвейеров и платформ, необходимых для аналитики, отчетности и продвинутого data science.

Кандидат будет владеть публикацией и поддержкой Data Lake, обеспечивая масштабируемость и готовность к будущему, работать в Agile и тесно сотрудничать с командами облачных решений и CI/CD.

Qualificações

• Опыт разработки конвейеров данных на практике и сопровождение ETL/ELT.
• Умение проектировать масштабируемые решения, базы данных и хранилища данных.
• Навыки работы в методологиях Agile и владение облачными технологиями.

Responsabilidades

• Разработка и улучшение ingestion и трансформационных конвейеров с использованием Spark, Scala, Python, AWS, DBT и Snowflake.
• Управление Data Lake и платформой данных, обеспечение масштабируемости и устойчивости.
• Ответственность за ETL‑обработку, обновление таблиц, исправление дефектов и BAU активностей.

Conhecimentos

Python

SQL

Data modeling

ETL/ELT

Data warehousing

Data leadership

Ferramentas

DBT

Apache Airflow

Spark

Scala

AWS

Snowflake

CI/CD

Descrição da vaga

Описание: Are you ready to shape the backbone of a data‑driven organisation? NewDay are looking for a Data Engineer to help us design, build, and evolve the core pipelines and platforms that power analytics, reporting, and sophisticated data science across our business.

Задачи:

• Developing and improving ingestion and transformation pipelines using technologies such as Spark, Scala, Python, AWS, DBT, and Snowflake
• Owning and improving the organisation's Data Lake environment and data platform. Ensuring it remains robust, scalable, and future‑ready
• Owning ETL processing, table refreshes, defect resolution, and other BAU activities
• Continuously optimising performance through concurrency, multi‑threading, automation, and best‑practice engineering patterns
• Working within Agile delivery frameworks to ship high‑quality, cloud‑native data solutions via CI/CD
• Integrating data from multiple sources and solving sophisticated data challenges with creativity.
• Design and develop modular, reusable scalable and configurable data engineering solutions that adhere to the D.R.Y principle, minimising manual intervention and promote automation.

Требования:

• Hands‑on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines. Manage task dependencies, automated retries and error handling to ensure reliable pipeline execution with minimal manual intervention.
• Engineering experience using Python and SQL, with the ability to solve complex data problems at scale.
• The ability to design and guide modern data engineering solutions, with knowledge of data modelling, ETL/ELT, data warehousing and scalable data pipelines.
• The ability to lead and develop Data Engineers, combining hands‑on technical contribution with coaching, technical direction and ownership of delivery.
• An interest in AI and automation, with the technical curiosity to explore how emerging technologies could improve engineering quality, productivity and ways of working.

Условия: Permanent