Senior Data Engineer: Build Scalable Real-Time Pipelines

Dotdigital; Greater London; Sur place; GBP 70 000 - 90 000; Plein temps

Avantages offerts par ce poste

Parental leave

Medical benefits

Paid sick leave

Share reward

Loyalty reward

Résumé du poste

Dotdigital is looking for a Senior Data Engineer to enhance our data platform capabilities. Join us to build scalable, intelligent data systems and collaborate with product and data science teams.

Responsibilities include designing data pipelines, optimizing processes, and delivering impactful data solutions. Ideal candidates have significant experience in Python and data engineering. Enjoy a flexible work culture and a focus on personal growth.

Qualifications

• Significant experience delivering Python-based projects for data engineering.
• Experience building and tuning Spark pipelines that run at scale across large quantities of data.
• Strong hands-on experience with SQL and NoSQL databases.

Responsabilités

• Design and build scalable, reliable, and secure data pipelines for streaming, batch, and real-time processing.
• Collaborate cross-functionally with engineers, analysts, and data scientists.
• Mentor and support junior engineers in data engineering principles.

Connaissances

Python-based projects

Building and tuning Spark pipelines

SQL and NoSQL databases

Modern data warehousing

Data orchestration tools

Cloud platforms

Event-driven architectures

Data modelling for OLAP and OLTP

Agile methodologies

Complex data engineering projects

Outils

Kafka

DBT

Snowflake

Airflow

Azure

AWS

GCP

Description du poste

Dotdigital is looking for a Senior Data Engineer to enhance our data platform capabilities. Join us to build scalable, intelligent data systems and collaborate with product and data science teams.

Responsibilities include designing data pipelines, optimizing processes, and delivering impactful data solutions. Ideal candidates have significant experience in Python and data engineering. Enjoy a flexible work culture and a focus on personal growth.