Senior Data Platform Engineer - Azure, Databricks & DevOps

Ninety One; Cape Town; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Ninety One in Cape Town is seeking a Senior Data Platform Engineer to design and sustain the firm’s Azure-based data layer with a focus on Databricks and automation.

You will collaborate across data, security and infrastructure teams to build reusable libraries and scalable pipelines, while upholding governance and cost controls. A strong Python/SQL background with Terraform and DevOps experience is essential.

Qualifications

• BSc Computer Science or equivalent.
• Minimum 7 years technology experience, with at least 3 years in cloud platform/data platform roles.
• Intermediate Databricks engineering experience.
• Intermediate knowledge of Microsoft Azure infrastructure.
• Proficiency in Python and/or SQL; .NET is a plus.
• Azure DevOps and/or GitHub Actions.
• Terraform (IaC) experience, ideally in a multi-environment setup.
• Understanding of Platform Governance, Security.
• Experience in Data Modelling, Data Contracts and exposure to FinOps/cost attribution practices.

Responsibilities

• Design, build and maintain solutions at the platform layer.
• Python solutions for platform and automation.
• Common shared libraries/modules used by data engineers and analysts across the platform.
• Pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring).
• CI/CD pipelines (DevOps/GitHub Actions) for platform and application deployments.
• Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies).
• Collaborate with data engineers, analysts, security and infrastructure teams to translate requirements into capabilities.
• Provide platform support to engineering teams and platform users including issue resolution.
• Contribute to platform documentation, patterns and best-practice standards.

Skills

Python

SQL

Databricks

Azure

DevOps

GitHub Actions

Terraform

Data Modelling

Cost attribution

Education

BSc Computer Science or equivalent

Tools

Azure Databricks

Azure DevOps

GitHub

Terraform

Job description

Ninety One in Cape Town is seeking a Senior Data Platform Engineer to design and sustain the firm’s Azure-based data layer with a focus on Databricks and automation.

You will collaborate across data, security and infrastructure teams to build reusable libraries and scalable pipelines, while upholding governance and cost controls. A strong Python/SQL background with Terraform and DevOps experience is essential.