Senior Data Engineer: Real-Time Data Pipelines & AI

dotdigital; Cape Town; On-site; ZAR 200 000 - 300 000; Full time

Job summary

A global marketing solutions provider in Cape Town is seeking a Senior Data Engineer to enhance their data platform. Responsibilities include designing scalable data pipelines, collaborating with analytics teams, and optimizing data processes with Python and SQL. The ideal candidate will have experience with cloud platforms and be proficient in both SQL and NoSQL databases, ensuring secure data movement and storage across the organization. Join a flexible work environment that promotes personal and professional growth.

Benefits

Parental leave

Medical benefits

Paid sick leave

Wellbeing Days

Qualifications

• Significant experience delivering Python-based projects for data engineering.
• Experience building spark pipelines that run at scale.
• Strong hands-on experience with SQL and NoSQL databases.

Responsibilities

• Design and build scalable, reliable, and secure data pipelines.
• Collaborate with Data Science teams to build scalable Pyspark workloads.
• Implement and optimise data models and storage solutions in a cloud environment.

Skills

Python

SQL

Data Engineering

Spark

NoSQL Databases

Tools

Airflow

Kafka

Cloud Platforms (Azure, AWS, GCP)

Job description

A global marketing solutions provider in Cape Town is seeking a Senior Data Engineer to enhance their data platform. Responsibilities include designing scalable data pipelines, collaborating with analytics teams, and optimizing data processes with Python and SQL. The ideal candidate will have experience with cloud platforms and be proficient in both SQL and NoSQL databases, ensuring secure data movement and storage across the organization. Join a flexible work environment that promotes personal and professional growth.