Databricks Platform Engineer: Enterprise Data Foundation

Whizdom; Sydney; On-site; AUD 140,000 - 210,000; Full time

Benefits offered by this job

Sydney-based opportunity

Modern Azure + Databricks stack

Migration project experience

Enterprise-scale platform design

Job summary

Whizdom is partnering with a leading enterprise to hire an experienced Databricks Platform Engineer in Sydney. You will design an enterprise Databricks platform foundation, spanning architecture, security, governance, automation and cloud infra to support a Synapse-to-Databricks migration.

You will define reusable patterns, implement CI/CD and IaC, and drive cost governance while ensuring scalable, secure data environments across Dev to Production.

Qualifications

• Experience with enterprise Databricks platforms and governance.
• Strong security, identity and network design skills on Azure.
• Proven ability to implement CI/CD and IaC for data platforms.

Responsibilities

• Design Databricks workspace, compute, networking, security and environment architecture across Dev, SIT, UAT and Production.
• Define integrations with ADLS Gen2, Entra ID, Key Vault, Azure networking, Azure DevOps, ADF, Purview and Azure Monitor.
• Establish CI/CD, Infrastructure-as-Code, Terraform and Databricks Asset Bundle standards.
• Develop platform automation standards and reusable implementation patterns.
• Define compute governance, performance, scalability and reliability strategies.
• Establish FinOps and cost optimisation approaches.
• Support the enterprise migration from Azure Synapse to Databricks.

Skills

Azure Databricks

Unity Catalog

Terraform

CI/CD

Platform automation

Azure security

Data governance

Azure services

Tools

Azure DevOps

Purview

Key Vault

ADLS Gen2

Azure Monitor

Job description

Whizdom is partnering with a leading enterprise to hire an experienced Databricks Platform Engineer in Sydney. You will design an enterprise Databricks platform foundation, spanning architecture, security, governance, automation and cloud infra to support a Synapse-to-Databricks migration.

You will define reusable patterns, implement CI/CD and IaC, and drive cost governance while ensuring scalable, secure data environments across Dev to Production.