Senior Data Engineer – Databricks & SAP Migration

Salt; Cape Town; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Hybrid work (Cape Town)

6-month contract

Cape Town location

Job summary

Salt is seeking a Senior Data Engineer to lead the migration from on-premises data to a Databricks-based, governed data platform. You will design with Medallion Architecture and Data Vault modelling, and partner with Finance/Economics teams to translate complex rules into the new model.

You will develop and maintain data pipelines using Databricks, PySpark, Python, and SQL, while engaging stakeholders up to the C-suite. The role is based in Cape Town, hybrid (3 days on-site per week).

Qualifications

• Senior-level Databricks experience with PySpark and Python.
• Strong SQL skills and Data Vault modelling.
• SAP exposure in Finance/Economics data domains.
• Experience migrating on-premises data to cloud or lakehouse.
• Ability to communicate progress and risks to C-suite.

Responsibilities

• Lead migration from on-prem to Databricks.
• Design data solutions with Medallion Architecture and Data Vault.
• Build data pipelines using Databricks, PySpark, Python, and SQL.
• Apply SAP data exposure to finance/economics workstreams.
• Translate complex business rules into governed data solutions.
• Engage C-suite and business stakeholders on progress.
• Ensure governance, quality, and security of the platform.

Skills

Databricks

PySpark

Python

SQL

Data Vault

Medallion Architecture

SAP exposure

Finance domain

Stakeholder comms

Tools

Databricks

Job description

About the Role

A large South African retailer is migrating from an on-premises data estate to Databricks, building a governed modern data platform using Medallion Architecture and Data Vault modelling. They need a Senior Data Engineer who can drive this migration technically, engage stakeholders up to C-suite level, and bring Finance and Economics data domain knowledge to ensure complex business rules translate correctly into the new platform.

Key Responsibilities

• Support and drive the migration from on-premises data infrastructure to Databricks
• Design and build data solutions using Medallion Architecture and Data Vault modelling principles
• Develop and maintain data pipelines using Databricks, PySpark, Python, and SQL
• Apply SAP data exposure to support finance and economics data workstreams through the migration
• Translate complex business and finance rules into robust, governed data engineering solutions
• Engage business and technical stakeholders, including C-suite, on migration progress and outcomes
• Ensure the emerging data platform meets governance, quality, and security standards

Requirements

• Senior-level Databricks experience, including PySpark and Python
• Strong SQL skills and experience with Data Vault modelling and Medallion Architecture
• SAP exposure, particularly within Finance or Economics data domains
• Experience managing data migrations from on-premises environments to cloud or lakehouse platforms
• Ability to communicate technical progress and risks clearly to C-suite stakeholders
• Finance or Economics data domain experience highly advantageous
• Duration: 6 months
• Location: Cape Town, hybrid (3 days on-site per week)