Senior Data Engineer (Native Databricks Preferred)

Sabenza IT & Recruitment; Cape Town; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading IT recruitment firm in Cape Town seeks a Senior Databricks Engineer/Architect with proven experience in SAP to Databricks migration. The ideal candidate will design and optimize data architectures within native Databricks environments, ensuring seamless data integration. Responsibilities include collaborating with business stakeholders and cloud teams, and implementing best practices for data governance. This is a great opportunity for someone with 3+ years of hands-on experience and Databricks certification in an innovative environment.

Qualifications

• Databricks Platform Architect Certification is mandatory.
• 3+ years of hands-on experience with native Databricks environments.
• Proven experience in migrating data from SAP to Databricks.
• Strong knowledge of PySpark, SQL, Delta Lake, and Databricks Workflows.
• Experience integrating Databricks with cloud data platforms.

Responsibilities

• Design and architect scalable data platforms and pipelines within native Databricks environments.
• Lead and execute SAP to Databricks migration projects.
• Collaborate with stakeholders to define architecture and data strategy.
• Implement best practices for data governance, security, and performance optimization.

Skills

Databricks Platform Architect Certification

Experience with native Databricks environments

Data migration from SAP to Databricks

Proficiency in PySpark

SQL expertise

Delta Lake knowledge

Data warehousing concepts

ELT/ETL design patterns

Experience with cloud data platforms

Data governance and security best practices

Job description

Cape Town, South Africa | Posted on 03/11/2025

We are seeking a highly skilled Senior Databricks Engineer / Architect with hands-on experience in native Databricks environments and a proven track record in SAP to Databricks data migration projects. The ideal candidate will be responsible for designing, implementing, and optimizing scalable data architectures that support advanced analytics, data engineering, and business intelligence initiatives.

Requirements

Key Responsibilities

Design and architect scalable data platforms and pipelines within native Databricks environments .

Lead and execute SAP to Databricks migration projects, ensuring seamless data integration and transformation.

Collaborate with business stakeholders, data engineers, and analysts to define architecture and data strategy.

Implement best practices for data governance, security, and performance optimization on the Databricks platform.

Develop and maintain data models, ETL processes , and automation frameworks for high-performance analytics.

Guide and mentor technical teams on Databricks architecture, implementation standards, and platform utilization.

Work closely with cloud teams (Azure, AWS, or GCP) to ensure seamless integration with enterprise data ecosystems.

Stay current with Databricks feature releases and advancements to continuously enhance platform capabilities.

Requirements

Databricks Platform Architect Certification (mandatory).

3+ years of hands-on experience working with native Databricks environments .

Proven experience in migrating data from SAP systems to Databricks .

Strong expertise in PySpark, SQL, Delta Lake, and Databricks Workflows .

Solid understanding of data warehousing concepts, data modeling, and ELT/ETL design patterns .

Experience integrating Databricks with cloud data platforms (AWS S3, GCP Storage, or Azure).

Knowledge of data governance, lineage, and security best practices .

Excellent problem-solving, analytical, and communication skills.

Experience in leading or architecting enterprise data solutions .