Senior Databricks Data Engineer — Azure Platform, Hybrid

Confluent; Cape Town; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Medical aid

Retirement annuity

Bursaries

Insurance

Job summary

Confluent Services, South Africa’s largest debt management company, is hiring a Senior Databricks Data Engineer to join the Data Team. You will design, build and evolve data pipelines and ingestion across on‑prem and cloud platforms.

You will work with a team of senior data engineers and participate in AI/ML initiatives, shaping the data platform’s evolution while focusing on clean architecture and thoughtful design.

Qualifications

• Minimum 3 years design/implementation of data pipelines and ETL processes.
• Experience with Azure Data Factory and Azure Databricks preferred.
• Strong SQL and Python coding skills with data structures and algorithms.

Responsibilities

• Contribute to architecture and design of the Confluent Data Platform.
• Develop, maintain and optimize production data pipelines on Azure Databricks.
• Ensure data security, quality and integrity across pipelines and processes.

Skills

Python

PySpark

SQL

SparkSQL

Data pipelines

ETL

Azure cloud

Communication

Education

Bachelor's degree in Computer Science/Eng/related

Tools

Azure Data Factory

Azure Databricks

Azure Cloud

Job description

Confluent Services, South Africa’s largest debt management company, is hiring a Senior Databricks Data Engineer to join the Data Team. You will design, build and evolve data pipelines and ingestion across on‑prem and cloud platforms.

You will work with a team of senior data engineers and participate in AI/ML initiatives, shaping the data platform’s evolution while focusing on clean architecture and thoughtful design.