Senior Databricks Architect & SAP Migration Lead

ATS Client; Cape Town; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

ATS Client is seeking a Senior Databricks Engineer/Architect to design and optimize scalable data platforms in native Databricks environments. You will lead SAP-to-Databricks migrations, implement governance, and collaborate with cloud teams.

Responsibilities include developing data models, ETL frameworks, and mentoring teams to adopt best practices in DataOps and security while staying current with Databricks advances in Azure, AWS, or GCP ecosystems.

Qualifications

• Databricks Platform Architect Certification is mandatory.

Responsibilities

• Design and architect scalable data platforms and pipelines within native Databricks environments.
• Lead and execute SAP to Databricks migration projects, ensuring seamless data integration and transformation.
• Collaborate with business stakeholders, data engineers, and analysts to define architecture and data strategy.
• Implement best practices for data governance, security, and performance optimization on the Databricks platform.
• Develop and maintain data models, ETL processes, and automation frameworks for high-performance analytics.
• Guide and mentor technical teams on Databricks architecture, implementation standards, and platform utilization.
• Work closely with cloud teams (Azure, AWS, or GCP) to ensure seamless integration with enterprise data ecosystems.
• Stay current with Databricks feature releases and advancements to continuously enhance platform capabilities.

Skills

Databricks Certification

Databricks environments

SAP to Databricks migration

PySpark

SQL

Delta Lake

Databricks Workflows

Data governance

Security best practices

Leadership/mentoring

Tools

Databricks

PySpark

SQL

Delta Lake

Databricks Workflows

AWS S3

Azure

GCP Storage

Job description

ATS Client is seeking a Senior Databricks Engineer/Architect to design and optimize scalable data platforms in native Databricks environments. You will lead SAP-to-Databricks migrations, implement governance, and collaborate with cloud teams.

Responsibilities include developing data models, ETL frameworks, and mentoring teams to adopt best practices in DataOps and security while staying current with Databricks advances in Azure, AWS, or GCP ecosystems.