Databricks Platform Engineer

Paxus; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Paxus is seeking an experienced Platform Engineer to design and establish the enterprise Databricks platform foundation, enabling secure, governed, scalable, and cost-efficient execution for migrated and future workloads.

You will oversee platform architecture across Dev, SIT, UAT and Prod, integrate with Azure services, implement CI/CD pipelines and IaC, and drive governance and FinOps strategies while supporting Synapse-to-Databricks migration.

Qualifications

• Databricks platform architecture in Azure
• Unity Catalog governance, access control and data security
• Terraform IaC and CI/CD pipelines
• Databricks APIs and automation
• Azure certification preferred

Responsibilities

• Platform Architecture: design workspace, compute, networking, security across Dev, SIT, UAT, Prod
• Azure Integration: integrate with ADLS Gen2, Entra ID, Key Vault, Azure Networking, Azure DevOps, ADF, Purview, Monitor
• Automation & CI/CD: establish CI/CD pipelines, Terraform, Databricks Asset Bundles, platform automation standards
• Governance & FinOps: define compute governance, performance, reliability, cost-optimization
• Migration Support: establish standards to support Synapse-to-Databricks migration

Skills

Databricks

Data Governance

Platform Automation

AI Tools

Azure Certifications

Tools

Terraform

Databricks APIs

Azure DevOps

Purview

ADLS Gen2

Key Vault

Job description

We are seeking an experienced Platform Engineer. In this role, you will design and establish the enterprise Databricks platform foundation, enabling secure, governed, scalable, and cost-efficient execution for both migrated and future workloads.

About the Role

We are seeking an experienced Platform Engineer. In this role, you will design and establish the enterprise Databricks platform foundation, enabling secure, governed, scalable, and cost-efficient execution for both migrated and future workloads.

Key Responsibilities

• Platform Architecture: Design workspace, compute, networking, security, and environment architecture across Dev, SIT, UAT, and Prod environments.

• Azure Integration: Define integrations with ADLS Gen2, Microsoft Entra ID, Key Vault, Azure Networking, Azure DevOps, ADF, Purview, and Azure Monitor.

• Automation & CI/CD: Establish CI/CD pipelines, Infrastructure-as-Code (Terraform), Databricks Asset Bundles, and platform automation standards.

• Governance & FinOps: Define compute governance, performance, scalability, reliability, and cost-optimization strategies.

• Migration Support: Establish platform standards and reusable patterns to support a Synapse-to-Databricks migration.

Skills & Experience

• Databricks Expertise: Strong expertise in Azure Databricks platform architecture and enterprise deployment.

• Data Governance: In-depth experience with Unity Catalog, including governance, access control, lineage, external locations, and data security.

• Platform Automation: Proven experience with Databricks-native capabilities and APIs.

• AI & Automation Tools: Exposure to AI-assisted platform engineering, automation, and agentic tools (e.g., Claude, Codex, or Gemini) is highly preferred.

• Certifications (Preferred):

  • Azure Solutions Architect Expert, and/or

  • Azure Databricks Data Engineer Associate

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.