Databricks & Cloud Data Platform Lead — Cape Town

DVT

Cape Town

On-site

ZAR 900,000 - 1,500,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DVT, based in Capetown, is hiring a Senior Data Engineer with Databricks expertise to design and deliver modern, scalable data platforms for enterprise clients. You will work closely with architects, analysts, data scientists, and client stakeholders to create secure, high-performing analytics platforms across cloud environments.

You will lead design efforts for lakehouse architectures, implement governance, and mentor junior engineers while delivering end-to-end data solutions using PySpark,

Qualifications

  • 8+ years in Data Engineering projects.
  • 3+ years of hands-on Databricks delivery experience.
  • Deep expertise in Python and PySpark.
  • Strong understanding of Medallion and Lakehouse architectures.
  • Experience building live Databricks dashboards using SQL.
  • Proficient with Azure data services (Synapse, ADF, OneLake, Purview).
  • Experience with AWS data platforms (Glue, S3, Redshift).
  • Consulting or client-facing environment experience.
  • Bachelor’s degree in computer science, engineering, information systems, or equivalent.

Responsibilities

  • Design and implement scalable Databricks-based data platforms.
  • Build ETL/ELT pipelines for batch and streaming workloads.
  • Lead data migration to cloud-based lakehouse architectures.
  • Develop data processing solutions using PySpark, Python, and SQL.
  • Implement Delta Lake, Unity Catalog, and Purview governance.
  • Design lakehouse and medallion architectures for enterprises.
  • Optimize Spark workloads for performance, cost, and scalability.
  • Create Databricks Workflows, Airflow, or similar orchestration.
  • Collaborate with stakeholders to define requirements.
  • Mentor junior engineers and contribute to best practices.
  • Produce architecture artefacts and reusable assets.

Skills

Databricks
Cloud data platforms
Mentoring

Education

Bachelor's degree in CS/Engineering

Tools

Databricks
Azure
AWS
Delta Lake
Unity Catalog
Purview
Airflow
ADF

Job description

DVT, based in Capetown, is hiring a Senior Data Engineer with Databricks expertise to design and deliver modern, scalable data platforms for enterprise clients. You will work closely with architects, analysts, data scientists, and client stakeholders to create secure, high-performing analytics platforms across cloud environments.

You will lead design efforts for lakehouse architectures, implement governance, and mentor junior engineers while delivering end-to-end data solutions using PySpark,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer (Databricks & Cloud Data Platforms)
Senior Data Engineer (Databricks & Cloud Data Platforms)

DVT • Cape Town

On-site
ZAR 900,000 - 1,500,000
Senior AWS Data Engineer — Databricks & Lakehouse Expert
Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Sabenza IT & Recruitment • Cape Town

On-site
ZAR 1,200,000 - 1,700,000
Senior Databricks Data Engineer — Onsite in Cape Town
Senior Databricks Data Engineer — Onsite in Cape Town

Hileya - Management Consulting • Sandton

On-site
ZAR 500,000 - 700,000
Databricks Principal Data Engineer: Build Pipelines
Databricks Principal Data Engineer: Build Pipelines

Sabenza IT • Cape Town

On-site
ZAR 1,100,000 - 1,700,000
Principal Data Engineer — Databricks & Platform Lead
Principal Data Engineer — Databricks & Platform Lead

Ats Client • Cape Town

On-site
ZAR 900,000 - 1,500,000
Senior Cloud Data Engineer - Remote | Lakehouse & Spark
Senior Cloud Data Engineer - Remote | Lakehouse & Spark

Hire Resolve • Cape Town

Remote
ZAR 700,000 - 950,000
Databricks AI Architect | Platform & Governance Lead
Databricks AI Architect | Platform & Governance Lead

Blue Pearl PTY • Johannesburg

On-site
ZAR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Parvana • Kraaifontein

Hybrid
ZAR 650,000 - 900,000
Data Engineer - Databricks & Snowflake | Flexible & Impactful
Data Engineer - Databricks & Snowflake | Flexible & Impactful

Bsky • Cape Town

Hybrid
ZAR 600,000 - 900,000