Databricks Platform Engineer

Whizdom; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job description

Databricks Platform Engineer

• Sydney, NSW
• Enterprise Azure Databricks Environment
• September Start

We are partnering with a leading enterprise organisation to engage an experienced Databricks Platform Engineer. This role will suit a platform specialist who enjoys designing secure, governed and scalable cloud data environments while establishing standards that support complex enterprise workloads.

About the Role

You will design and establish an enterprise Databricks platform foundation supporting migrated and future workloads. Working across architecture, security, governance, automation and cloud infrastructure, you will create reusable platform patterns and standards to support a Synapse-to-Databricks migration.

Key Responsibilities

• Design Databricks workspace, compute, networking, security and environment architecture across Dev, SIT, UAT and Production.
• Define integrations with ADLS Gen2, Entra ID, Key Vault, Azure networking, Azure DevOps, ADF, Purview and Azure Monitor.
• Establish CI/CD, Infrastructure-as-Code, Terraform and Databricks Asset Bundle standards.
• Develop platform automation standards and reusable implementation patterns.
• Define compute governance, performance, scalability and reliability strategies.
• Establish FinOps and cost optimisation approaches.
• Support the enterprise migration from Azure Synapse to Databricks.

Skills & Experience

To be successful in this role, you will have:

• Strong expertise in Azure Databricks platform architecture and enterprise deployment.
• Strong Unity Catalog experience across governance, access control, lineage, external locations and data security.
• Experience with Databricks-native platform capabilities and APIs.
• Experience with Terraform, Infrastructure-as-Code, CI/CD and platform automation.
• Strong understanding of Azure data, identity, networking, monitoring and security services.
• Experience designing governed, scalable and cost-efficient data platforms.
• Azure Solutions Architect Expert and/or Azure Databricks Data Engineer Associate certification.
• Exposure to AI-assisted platform engineering, automation or agentic tools such as Claude, Codex or Gemini would be advantageous.

What’s on Offer?

• Sydney-based opportunity.
• Opportunity to establish an enterprise Databricks platform foundation.
• Work across architecture, governance, security, automation and optimisation.
• Contribute to a significant Synapse-to-Databricks migration.
• Work with a modern Azure and Databricks technology stack.

If you’re an experienced Azure Databricks Platform Engineer with strong expertise in enterprise architecture, Unity Catalog and platform automation, we’d love to hear from you.

Candidates will need to be willing to undergo pre-employment screening checks, which may include identity and work rights checks, security clearance verification and any other client-requested check