Databricks Principal Data Engineer: Build Pipelines

Sabenza IT

Cape Town

Presencial

ZAR 1.100.000 - 1.700.000

Tempo integral

Há 11 dias

Uma candidatura completa em um minuto

Currículo e carta de apresentação personalizados, prontos para serem enviados.

Passe pelos filtros ATS

Resumo da vaga

Sabenza IT in Cape Town, South Africa, is seeking a Principal Data Engineer to lead hands-on development of robust production data pipelines on Databricks and to raise engineering standards across the team. The role interfaces with business stakeholders, department heads, and data owners in Finance and IT to deliver trusted data products.

You will optimise the platform for performance and cost, define a semantic layer and metrics, and coach junior engineers while driving data quality and

Qualificações

  • Three+ years of hands-on Databricks experience.
  • Familiarity with Spark Declarative Pipelines (SDP) and Metric Views.
  • Strong programming skills in Python, SQL and Spark.
  • Experience in data modelling, database design and query optimisation.
  • Experience coaching junior engineers and influencing stakeholders.

Responsabilidades

  • Design and build production-grade data pipelines on Databricks.
  • Optimize platform for performance and cost, manage storage and layout.
  • Define and maintain consistent business metrics and a semantic layer.
  • Integrate data from SAP S/4HANA and other sources using Fivetran/HVR.
  • Set engineering standards across the team including CI/CD and data governance.
  • Coach and mentor junior and mid-level engineers; review work.
  • Engage with stakeholders to shape practical, high-value solutions.
  • Work with Finance and IT data owners to ensure data quality.

Conhecimentos

Databricks
Spark Declarative Pipelines (SDP)
Metric Views
Python
SQL
Spark
Data modelling
Database design
Query optimisation
Stakeholder management

Formação

Relevant tertiary qualification in Computer Science/Information Systems/Engineering or related field

Ferramentas

SAP S/4HANA
Fivetran
HVR
Power BI semantic modelling

Descrição da vaga

Sabenza IT in Cape Town, South Africa, is seeking a Principal Data Engineer to lead hands-on development of robust production data pipelines on Databricks and to raise engineering standards across the team. The role interfaces with business stakeholders, department heads, and data owners in Finance and IT to deliver trusted data products.

You will optimise the platform for performance and cost, define a semantic layer and metrics, and coach junior engineers while driving data quality and

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Sabenza IT & Recruitment • Cape Town

Presencial
ZAR 1.200.000 - 1.700.000
Principal Data Engineer — Databricks & Platform Lead
Principal Data Engineer — Databricks & Platform Lead

Ats Client • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Databricks Lakehouse Engineer: Build & Tune Pipelines
Databricks Lakehouse Engineer: Build & Tune Pipelines

Sabenza IT & Recruitment • Eersterivier

Presencial
ZAR 900.000 - 1.300.000
Databricks & Cloud Data Platform Lead — Cape Town
Databricks & Cloud Data Platform Lead — Cape Town

DVT • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Sabenza IT • Cape Town

Presencial
ZAR 1.100.000 - 1.700.000
Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Ats Client • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Senior Data Engineer: Build Trusted Data Pipelines
Senior Data Engineer: Build Trusted Data Pipelines

Sabenza IT & Recruitment • Pretoria

Presencial
ZAR 700.000 - 1.100.000
Senior Data Engineer: Data Pipelines & AI Governance
Senior Data Engineer: Data Pipelines & AI Governance

Sabenza IT & Recruitment • Centurion

Presencial
ZAR 900.000 - 1.400.000
Senior Data Engineer - Cloud Pipelines & AI Tools
Senior Data Engineer - Cloud Pipelines & AI Tools

Sabenza IT • Gauteng

Presencial
ZAR 600.000 - 900.000
Senior Data Engineer - Databricks | Hybrid Parktown
Senior Data Engineer - Databricks | Hybrid Parktown

Sasso Consulting (Pty) Ltd • Johannesburg

Híbrido
ZAR 796.000 - 1.133.000