Data Architect (databricks / data modelling essential)

Be Different; Sandton; On-site; ZAR 900,000 - 1,800,000; Full time

Job summary

Be Different is seeking a Senior Data Architect to design and implement enterprise-scale data platforms on Microsoft Azure, aligning with insurance industry requirements. The role emphasizes data modeling, governance, and modern data services to enable planning units with actionable insights.

Responsibilities include leading data modernization, ensuring security and compliance, and driving automation with DevOps practices. Collaboration with cross-functional teams is essential for success.

Qualifications

• 7+ years of experience in enterprise-level data architecture, solution design and modeling in insurance data technologies.
• Experience leading large-scale data platform implementations across hybrid and cloud environments.
• Design scalable, secure, cost-effective data architectures aligned with requirements.

Responsibilities

• Architect scalable data platforms using Microsoft Azure technologies (Azure SQL, Synapse, Cosmos DB, Data Lake, Databricks).
• Lead data modernization initiatives and oversee migration strategies.
• Govern data lifecycle, compliance (POPIA, GDPR) and metadata management.
• Enable BI & analytics with Power BI, Analysis Services and ML tools.
• Support application development and integration with data contracts and APIs.
• Champion CI/CD, IaC (Terraform) and automated data workflows.
• Collaborate across enterprise teams and governance bodies.
• Mentor junior architects and engineers to foster best practices.
• Ensure data quality management and observability across pipelines.

Skills

Data architecture

Cloud architecture (Azure)

Data modeling

Data quality & observability

Master Data Management

BI & automation

Security & governance

DevOps & IaC

Cross-functional collaboration

Insurance domain knowledge

Education

BCom or BSc degree (IT/Business)

Tools

Azure SQL Database

Azure Synapse Analytics

Azure Cosmos DB

Azure Blob Storage

Azure Data Lake Storage

Azure Data Factory

Azure Stream Analytics

Azure Analysis Services

Azure Machine Learning

Power BI

Databricks

Visio

Job description

The following is required to be considered for this position:

• BCom or BSc degree or equivalent in IT | Business qualification
• Minimum 7 years of experience in enterprise-level data architecture, solution design and modeling of insurance-based data technologies
• Proven ability to lead large-scale data platform implementations across hybrid and cloud environments
• Expertise in designing scalable, secure and cost-effective data architectures in the cloud aligned with business and regulatory requirements
• Extensive hands-on experience with:

1. Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB
2. Azure Blob Storage, Azure Data Lake Storage
3. Azure Data Factory, Azure Stream Analytics
4. Azure Analysis Services, Azure Machine Learning

• Strong understanding of Azure-native data integration, transformation and analytical capabilities

Data Modeling and Semantic Layer Design:

• Proficient in conceptual, logical and physical data modeling using tools like Visio, Azure Synapse, Power BI and Databricks
• Experience designing semantic models for Power BI and Azure Analysis Services to support enterprise-wise reporting
• Skilled in dimensional modeling, star/snowflake schemas and metadata management

Data Quality and Observability:

• Implemented data quality frameworks and observability practices using Azure Monitor, Purview and custom telemetry tools working closely with the Data Architect
• Experience with anomaly detection, data validation rules and lineage tracking to ensure trust and transparency
• Defined and monitored data SLA’s and KPI’s across business-critical pipelines

Master Data Management (MDM):

• Experience implementing and integrating Master Data Management solutions to ensure consistency of key business entities across systems
• Defined governance models and stewardship processes for managing golden records, resolving data conflicts, data retention working closely with the Data Centre of Excellence
• Worked with Microsoft Purview and other MDM tools to support data cataloging, lineage and reference data management

Business Intelligence & Automation:

• Proficiency in Power BI, Power Apps, Power Automate, and Microsoft 365 tools
• Experience designing interactive dashboards and automating business workflows

Cloud Security & Governance:

• Familiarity with Azure Security Center, Azure Monitor, Azure Policy and Azure Backup
• Experience implementing security best practices and compliance frameworks (POPIA, GDPR)
• Hands-on experience with Microsoft Purview and/or other data governance tools

DevOps & Infrastructure as Code:

• Experience with Azure DevOps, CI/CD pipelines, Terraform, and Machine Learning Ops
• Ability to manage infrastructure and deployments using automated tooling and IaC principles

Cross-Functional Collaboration:

• Demonstrated success working with enterprise solutions architect, data engineers, analysts, developers, and business stakeholders.
• Experience participating in architecture forums, steering committees, and governance bodies.

1. 5+ years domain knowledge in Insurance (Short Term / Life / Microinsurance / Health Insurance)
2. Experience in aligning data strategies with regulatory and operational needs in the insurance sector

Duties & Responsibilities

Architect Scalable Data Platforms:

• Design and implement enterprise-grade data architectures using Microsoft Azure technologies including Azure SQL, Synapse, Cosmos DB, Data Lake, Databricks, PySpark Notebooks and Dataverse
• Ensure platforms are secure, resilient and optimized for performance and cost
• Establish scalable data modeling practices, including conceptual, logical and physical models aligned with business domains

Lead Data Modernization Initiatives:

• Drive the transformation of legacy systems into cloud-native solutions from a data technology perspective
• Promote the adoption of modern data services and analytics tools across the organization
• Oversee migration strategies, including schema conversions, data mapping and validation processes

Govern Data Lifecycle and Compliance:

• Define and enforce standards for data sourcing, structuring, validation, storage and security, working closely with the Data Centre of Excellence
• Ensure compliance with POPIA, GDPR and internal governance frameworks
• Assist the business data architect with implementation of metadata management, data cataloging and sensitive data tracking initiatives
• Support discoverability and lineage tracking

Enable Business Intelligence and Analytics:

• Integrate tools such as Power BI, Azure Analysis Services and Azure Machine Learning to support decision-making, enabling the Data Teams in the Planning Units of the business
• Collaborate with business units to deliver actionable insights through data visualization and predictive modeling
• Support semantic modeling and KPI definitions to ensure consistent reporting across data teams

Support Application Development and Integration:

• Provide architectural guidance for .NET-based applications and data-driven solutions working with the Enterprise Solutions Architect
• Enable seamless integration across Microsoft 365, Power Platform, Dynamics 365 and SharePoint / Teams
• Ensure data contracts are well-defined for interoperability and reuse

Champion Automation and DevOps Practices:

• Implement CI/CD pipelines, infrastructure-as-code (Terraform) and automated data workflows using Azure Data Factory and Power Automate
• Promote DevOps culture and tooling across data engineering teams
• Monitor and optimize ETL pipelines, ensuring observability, reliability and scalability

Collaborate Across Teams and Stakeholders:

• Work closely with enterprise solutions architect, data architect, data engineers, developers, analysts and business teams to align technology with strategic goals
• Represent the business in architecture forums, steering committees and cloud governance bodies from a data technologies perspective
• Facilitate cross-functional data governance and stewardship initiatives

Mentor and Develop Talent:

• Guide junior architects and engineers in best practices and certification pathways
• Foster a culture of continuous learning and innovation within the data technology space
• Encourage hands-on experience with data modeling tools, ETL frameworks and Azure services

Ensure Data Quality Management and Observability:

• Define and implement data quality frameworks to monitor accuracy, completeness, consistency and timeliness across data assets working closely with the Data Architect
• Implement observability tools such as Azure Log Analytics, Application Insights, Purview to track data lineage, usage patterns and health

Information displayed above not limited to advertisement.

Please consider your application as unsuccessful if you have not received a response within 14 days of submitting your application.