Senior Data Engineer: Build Scalable Real-Time Pipelines

Dotdigital; Greater London; On-site; GBP 70,000 - 90,000; Full time

Benefits offered by this job

Parental leave

Medical benefits

Paid sick leave

Share reward

Loyalty reward

Job summary

Dotdigital is looking for a Senior Data Engineer to enhance our data platform capabilities. Join us to build scalable, intelligent data systems and collaborate with product and data science teams.

Responsibilities include designing data pipelines, optimizing processes, and delivering impactful data solutions. Ideal candidates have significant experience in Python and data engineering. Enjoy a flexible work culture and a focus on personal growth.

Qualifications

• Significant experience delivering Python-based projects for data engineering.
• Experience building and tuning Spark pipelines that run at scale across large quantities of data.
• Strong hands-on experience with SQL and NoSQL databases.

Responsibilities

• Design and build scalable, reliable, and secure data pipelines for streaming, batch, and real-time processing.
• Collaborate cross-functionally with engineers, analysts, and data scientists.
• Mentor and support junior engineers in data engineering principles.

Skills

Python-based projects

Building and tuning Spark pipelines

SQL and NoSQL databases

Modern data warehousing

Data orchestration tools

Cloud platforms

Event-driven architectures

Data modelling for OLAP and OLTP

Agile methodologies

Complex data engineering projects

Tools

Kafka

DBT

Snowflake

Airflow

Azure

AWS

GCP

Job description

Dotdigital is looking for a Senior Data Engineer to enhance our data platform capabilities. Join us to build scalable, intelligent data systems and collaborate with product and data science teams.

Responsibilities include designing data pipelines, optimizing processes, and delivering impactful data solutions. Ideal candidates have significant experience in Python and data engineering. Enjoy a flexible work culture and a focus on personal growth.