Principal Data Engineer — Databricks & Platform Lead

Ats Client

Cape Town

Presencial

ZAR 900.000 - 1.500.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

ATS Client in Cape Town seeks a Principal Data Engineer to lead production data pipelines on Databricks and elevate engineering standards. You will drive performance, cost optimisation, and design robust data models in collaboration with Finance and IT stakeholders.

You will mentor junior engineers, influence business stakeholders, and work with SAP S/4HANA data sets, Fivetran connectors and Power BI semantic modelling to deliver trusted data solutions.

Formación

  • 3+ years hands-on Databricks experience in pipelines and optimisation.
  • Familiar with Spark Declarative Pipelines (SDP) and Metric Views.
  • Strong Python/SQL/Spark programming skills.
  • Experience with data modelling, database design and query optimisation.
  • Experience coaching junior developers.
  • Ability to influence business stakeholders.
  • Experience with SAP S/4HANA data sets, Fivetran (SaaS connectors/HVR) and Power BI modelling.

Responsabilidades

  • Designing and building robust, production‑grade data pipelines on Databricks, using SDP when appropriate.
  • Optimising platform performance and cost by tuning compute, jobs, queries, storage and layout.
  • Defining and maintaining consistent business metrics and a semantic layer for trusted reporting.
  • Integrating data from core business systems (SAP S/4HANA) and other sources using Fivetran.
  • Setting engineering standards across the team including CI/CD and data governance.
  • Coaching and mentoring junior engineers and reviewing their work.
  • Partnering with stakeholders to understand needs and deliver practical solutions.
  • Engaging data owners to ensure data quality and fit for purpose.

Conocimientos

Databricks
Python
SQL
Spark
coaching
Stakeholder management
SAP S/4HANA
Fivetran
Power BI semantic modelling

Herramientas

SDP
Metric Views

Descripción del empleo

ATS Client in Cape Town seeks a Principal Data Engineer to lead production data pipelines on Databricks and elevate engineering standards. You will drive performance, cost optimisation, and design robust data models in collaboration with Finance and IT stakeholders.

You will mentor junior engineers, influence business stakeholders, and work with SAP S/4HANA data sets, Fivetran connectors and Power BI semantic modelling to deliver trusted data solutions.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Sabenza IT & Recruitment • Cape Town

Presencial
ZAR 1.200.000 - 1.700.000
Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Sabenza IT • Cape Town

Presencial
ZAR 1.100.000 - 1.700.000
Databricks Principal Data Engineer: Build Pipelines
Databricks Principal Data Engineer: Build Pipelines

Sabenza IT • Cape Town

Presencial
ZAR 1.100.000 - 1.700.000
Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Ats Client • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Principal Data Engineer
Principal Data Engineer

Placements24 • Stellenbosch

Híbrido
ZAR 1.500.000 - 2.500.000
Health insurance
Retirement contributions
Life assurance
+4
Databricks & Cloud Data Platform Lead — Cape Town
Databricks & Cloud Data Platform Lead — Cape Town

DVT • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Senior Data Platform Architect & ETL Leader
Senior Data Platform Architect & ETL Leader

Ats Client • Johannesburg

Presencial
ZAR 1.200.000 - 1.800.000
Data Engineer
Data Engineer

Parvana • Kraaifontein

Híbrido
ZAR 650.000 - 900.000
Senior AWS Data Engineer — Databricks & Lakehouse Expert
Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group • Johannesburg

Presencial
ZAR 900.000 - 1.300.000
Data Engineer - Datalake & Revenue Insights
Data Engineer - Datalake & Revenue Insights

Ats Client • Johannesburg

Presencial
ZAR 850.000 - 1.250.000