Architect (ATC)

Virtusa; Sydney; On-site; AUD 140,000 - 210,000; Full time

Job summary

Virtusa seeks an Azure Databricks Admin Architect to design and govern the Azure Databricks platform for Allianz-aligned standards. You will secure, scale, and optimize the environment and ensure reliable operations across Azure services and data governance.

You will collaborate with data engineering, cybersecurity, and operations teams to implement CI/CD, IaC, monitoring, and disaster recovery while driving platform-wide best practices.

Responsibilities

• Design and manage the Azure Databricks platform architecture.
• Configure and administer Databricks workspaces, clusters, SQL warehouses, jobs, and compute policies.
• Implement Unity Catalog for data governance, access control, lineage, and data security.
• Integrate Databricks with Azure services, including ADLS Gen2, Azure Key Vault, Microsoft Entra ID, Azure DevOps, and Azure Monitor.
• Configure network security, including VNet injection, private endpoints, Private Link, firewalls, and secure connectivity.
• Establish role-based access control, identity management, service principals, and privileged access processes.
• Develop platform standards for cluster configuration, libraries, secrets, workspace management, and resource usage.
• Implement monitoring, alerting, logging, audit controls, backup, and disaster-recovery processes.
• Optimise platform performance, capacity, and cloud consumption costs.
• Support CI/CD automation and Infrastructure as Code using Terraform, Azure DevOps, or similar tools.
• Troubleshoot platform, connectivity, security, performance, and access-related issues.
• Work with data engineering, cloud cybersecurity, architecture, and operations teams.
• Prepare platform architecture, operational procedures, standards, and technical documentation.
• Support production deployments, upgrades, patching, incident management, and platform operations.

Job description

Role Overview

The Azure Databricks Admin Architect will be responsible for designing, implementing, administering, and governing the Azure Databricks platform. The role will ensure the platform is secure, scalable, reliable, and aligned with Allianz cloud, data, security, and compliance standards.

Key Responsibilities

• Design and manage the Azure Databricks platform architecture.


• Configure and administer Databricks workspaces, clusters, SQL warehouses, jobs, and compute policies.


• Implement Unity Catalog for data governance, access control, lineage, and data security.


• Integrate Databricks with Azure services, including ADLS Gen2, Azure Key Vault, Microsoft Entra ID, Azure DevOps, and Azure Monitor.


• Configure network security, including VNet injection, private endpoints, Private Link, firewalls, and secure connectivity.


• Establish role-based access control, identity management, service principals, and privileged access processes.


• Develop platform standards for cluster configuration, libraries, secrets, workspace management, and resource usage.


• Implement monitoring, alerting, logging, audit controls, backup, and disaster-recovery processes.


• Optimise platform performance, capacity, and cloud consumption costs.


• Support CI/CD automation and Infrastructure as Code using Terraform, Azure DevOps, or similar tools.


• Troubleshoot platform, connectivity, security, performance, and access-related issues.


• Work with data engineering, cloud, cybersecurity, architecture, and operations teams.


• Prepare platform architecture, operational procedures, standards, and technical documentation.


• Support production deployments, upgrades, patching, incident management, and platform operations.