Technology Architect – Data Platforms

Guardrisk; City of Johannesburg Metropolitan Municipality; On-site; ZAR 1,100,000 - 1,900,000; Full time

Job summary

Guardrisk, a leading insurer in South Africa, seeks a Technology Architect – Data Platforms to own the Azure-based lakehouse. You will drive secure, scalable design using Azure Databricks, Delta Lake and Unity Catalog, coordinating CI/CD, IaC, and cost governance across data teams.

Qualified candidates should have 8+ years in data platforms, 3+ in architecture, and relevant Azure Databricks certifications. This role reports to the Enterprise Solutions Architect and collaborates with data

Qualifications

• Appropriate 3/4 year IT/Business qualification – B Com or B Sc degree or equivalent.
• Certifications beneficial: Databricks Certified Data Engineer Professional, Microsoft Azure Data Engineer Associate or Azure Solutions Architect Expert, or equivalent.
• Minimum 8 years of experience in data engineering or data platform roles, with at least 3 years in architecture.
• Proven delivery of at least one enterprise-scale cloud data platform implementation or migration on Microsoft Azure.
• Expertise in designing scalable, secure and cost-effective cloud data platforms.

Responsibilities

• Architect and own the Azure Data Platform (25%).
• Design and maintain the technical architecture of the Guardrisk data platform on Azure Databricks and Azure Data Lake Storage.
• Ensure the platform is secure, resilient, high-performing and cost-effective.
• Translate data models into physical implementation patterns (Delta tables, partitioning, performance).
• Lead the Synapse-to-Databricks migration and define reusable ingestion patterns.
• Implement Unity Catalog, access controls and automated permissions.
• Define CI/CD and infrastructure-as-code for data pipelines and platform components.
• Monitor observability and cost management; optimise Databricks workloads.
• Collaborate with Architects, data engineers and BI teams.

Skills

Data platforms

Azure Databricks

Cloud architecture

DevOps

Terraform

CI/CD

Observability

Security controls

Leadership

Mentoring

Education

BCom or BSc degree

Tools

Azure Data Factory

Delta Lake

Purview

Entra ID

Databricks

Azure Monitor

Job description

Guardrisk is the undisputed market leader in cell captive insurance and risk solutions. We are renowned for our innovative approach to cell captive structures and other alternative risk transfer solutions for our clients. Guardrisk offers clients custom designed cover and is registered in South Africa as an insurer for all statutory classes of non-life and life insurance business.

Role Purpose

Guardrisk operates in a data-intensive environment where vast volumes of information must be sourced, switched, structured, validated, stored, secured, and made readily available to the business. Technology is not just an enabler—it is a strategic imperative.

The purpose of this role is to own the technical architecture of Guardrisk’s data platform on Microsoft Azure and Azure Databricks, ensuring it is secure, reliable, scalable and cost-effective. The Technology Architect – Data Platforms is accountable for how the platform is built, secured, deployed, operated and optimised, so that data engineering and Data Centre of Excellence (Data CoE) teams can deliver trusted data products to the business.

The role will lead the technical design and implementation of the lakehouse platform (medallion architecture: raw, enriched and curated layers) using Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage and Azure Data Factory, including the technical delivery of the Synapse-to-Databricks migration. It will define platform standards for security and access, infrastructure-as-code, CI/CD, observability and cost management.

Scope boundary: Business and logical data architecture, semantic layer and KPI definitions, master data management, data stewardship and data quality rules are owned by the Data CoE. This role provides the technical platform capabilities that implement and enforce those designs and policies.

This role will report into the Guardrisk Enterprise Solutions Architect.

The main functions:

• Architect and Own the Azure Data Platform (25%)
• Design and maintain the technical architecture of the Guardrisk data platform on Azure Databricks and Azure Data Lake Storage (medallion: raw, enriched and curated layers), including compute, storage, networking and integration patterns.
• Ensure the platform is secure, resilient, high-performing and cost-effective, and aligned with Guardrisk’s enterprise architecture standards.
• Translate logical data models and data product designs from the Data CoE into physical implementation patterns (Delta table design, partitioning, performance optimisation).
• Lead Platform Modernisation and Migration (20%)
• Lead the technical architecture of the Synapse-to-Databricks migration, including migration patterns, reconciliation, cut-over and decommissioning of legacy components.
• Define reference architectures and reusable ingestion patterns (batch, streaming, change data capture, file and API) for policy administration and other source systems.
• Evaluate and recommend new Azure and Databricks capabilities in conjunction with the Enterprise Solutions Architect.
• Secure the Platform and Enable Governance Controls (15%)
• Implement the Unity Catalog technical structure (metastore, catalogs, schemas), access control and automated permission management through Entra ID groups and infrastructure-as-code, in line with access policies set by the Data CoE.
• Implement platform controls that support POPIA, Joint Standards and Prudential Authority requirements, including encryption, private networking, secrets management and audit logging.
• Provide the technical integration for cataloguing, lineage and sensitive data classification (e.g. Microsoft Purview) as defined by the Data CoE.
• Champion Platform Engineering, DevOps and Automation (15%)
• Define and implement CI/CD, infrastructure-as-code (Terraform) and environment strategy (development, test, production) for data pipelines and platform components.
• Standardise orchestration (Databricks Workflows, Azure Data Factory) and pipeline engineering patterns across data engineering teams.
• Ensure Platform Reliability, Observability and Cost Management (15%)
• Implement platform monitoring, pipeline observability and alerting using Azure Monitor, Log Analytics and Databricks system tables.
• Provide the technical capability to run data quality checks within pipelines, based on rules defined by the Data CoE.
• Manage and optimise Databricks and Azure data platform costs through cluster policies, budgets, tagging and consumption reporting.
• Act as the technical escalation point for complex platform incidents and drive root-cause resolution.
• Collaborate, Set Standards and Enable Teams (10%)
• Work closely with the Enterprise Solutions Architect, the Data CoE Data Architect, data engineers, BI developers and Planning Unit data teams.
• Represent the data platform perspective in architecture forums and design authorities.
• Coach data engineers on platform standards, engineering best practice and certification pathways.
• Ability to mentor the business on data technologies.
• Ability to provide technical leadership and coaching to data engineers.
• Ability to explain complicated concepts in simple terms.
• Knowledge of file, API and change-data-capture ingestion patterns (SFTP, REST, CDC)
• Intensive troubleshooting knowledge
• Analytical
• Strong problem-solving skills
• Excellent communication, interpersonal and presentation skills
• Self-driven with an ability to work independently as well as to function effectively within a team
• Strong sense of responsibility and accountability and to be decisive when needed
• Effective planning and organizational skills
• Ability to work under pressure
• Ability to function in a team
• Written and Verbal Communication Skills
• Keep abreast of developments in Azure and Databricks data platform technologies
• Customer-centric mindset, delivering data solutions for the business

Qualifications

Appropriate 3/4 year IT/Business qualification – B Com or B Sc degree or equivalent

Certifications beneficial: Databricks Certified Data Engineer Professional, Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert, or equivalent

Experience

• Technology Architecture – Data Platforms
• Minimum 8 years of experience in data engineering or data platform roles, of which at least 3 years in a platform or solution architecture capacity.
• Proven delivery of at least one enterprise-scale cloud data platform implementation or migration on Microsoft Azure.
• Expertise in designing scalable, secure and cost-effective cloud data platforms aligned with business and regulatory requirements.
• Azure Databricks and Azure Data Services
• Extensive hands-on experience with:
• Exposure to streaming and change data capture (e.g. Event Hubs, Structured Streaming) beneficial.
• Platform Security and Access Management
• Experience with Microsoft Entra ID, Azure RBAC, private networking, Azure Key Vault, Microsoft Defender for Cloud and Azure Policy.
• Experience automating data access permissions and implementing platform controls in a regulated environment (POPIA or equivalent).
• DevOps & Infrastructure as Code
• Experience with Azure DevOps or GitHub, CI/CD pipelines for data workloads and Terraform; Databricks Asset Bundles beneficial.
• Platform Operations, Observability and Cost
• Experience with Azure Monitor, Log Analytics and pipeline monitoring and alerting.
• Demonstrated cost management and performance optimisation of Spark / Databricks workloads.
• Physical Data Design
• Physical implementation of lakehouse and dimensional models (Delta table design, partitioning, star schemas) based on logical designs provided by data architects.
• Cross-Functional Collaboration
• Demonstrated success working with enterprise and data architects, data engineers, analysts and business stakeholders.
• Experience participating in architecture forums and design authorities.
• Advantageous
• Financial services or insurance industry experience.
• Exposure to Microsoft Purview and Power BI platform administration.

Soft Skills

• Strategic Thinking
• Drive for Results
• Leads Change and Innovation
• Motivating and Inspiring teams
• Coaching and Knowledge Sharing
• Impact and Influence
• Self-Awareness and Insight
• Diversity and Inclusiveness

Data Integration & Orchestration

Governance Enablement (Technical)

Unity Catalog access control and lineage, automated permissions, Microsoft Purview integration, data quality checks in pipelines (rules defined by the Data CoE)

Platform Operations & Observability

Azure Monitor, Log Analytics, Databricks system tables, alerting, incident and problem management

Physical Data Design

Delta table design, partitioning and optimisation, physical implementation of dimensional models (star schemas)

Should you not hear from us within 21 days, kindly consider your application unsuccessful.