Data Platform Engineer

Skywaves Rise; Johannesburg; Hybrid; ZAR 600,000 - 1,200,000; Full time

Job summary

Skywaves Rise in Sandton, Johannesburg is seeking an Infrastructure & Data Platform Engineer to support Azure Databricks and automation. Hybrid work arrangement with 3 days in the office weekly.

The role blends infrastructure engineering with data platform practices to ensure reliable, automated, self-service environments for platform users.

Qualifications

• Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage).
• Hands‑on Azure Databricks experience (Unity Catalog, cluster/job management).
• Terraform (IaC) experience, ideally in a multi‑environment setup.
• Proficiency in Python; working knowledge of SQL; .NET is a plus.
• Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar).
• Understanding of data platform governance and cost.

Responsibilities

• Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments.
• Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies).
• Develop and support application code in Python and/or .NET for platform tooling and automation.
• Build and maintain shared libraries/modules used by data engineers and analysts across the platform.
• Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring).
• Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities.
• Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity).
• Contribute to platform documentation and best-practice standards.

Skills

Azure infrastructure

Azure Databricks

Terraform IaC

Python

SQL

.NET

CI/CD pipelines

Azure DevOps

GitHub Actions

cost governance

Tools

Terraform

Azure Databricks

Azure DevOps

GitHub Actions

Unity Catalog

Job description

Location : Sandton, Johannesburg[ 3 Days in a week from office]

Purpose

Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks & Azure environment reliable, automated, and self-service for platform users.

Key Responsibilities

• Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
• Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
• Develop and support application code in Python and/or .NET for platform tooling and automation
• Build and maintain shared libraries/modules used by data engineers and analysts across the platform
• Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
• Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
• Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
• Contribute to platform documentation and best-practice standards

Required Skills & Experience

• Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
• Hands‑on Azure Databricks experience (Unity Catalog, cluster/job management)
• Terraform (IaC) experience, ideally in a multi‑environment setup
• Proficiency in Python; working knowledge of SQL; .NET is a plus
• Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
• Understanding of data platform governance and cost