Senior Azure Databricks Platform Engineer AI & Lakehouse

XPT Software Australia Pty Ltd; Sydney; On-site; AUD 180,000 - 260,000; Full time

Job summary

XPT Software Australia Pty Ltd is seeking a Senior Azure Databricks Platform Engineer (5+ years) to join our platform team in Sydney. You will enhance AI capabilities within Azure Databricks, manage platform operations, and drive automation and security best practices.

Key areas include Terraform-based infrastructure, CI/CD with Azure DevOps, and data-lake technologies such as Spark, Delta Lake, and Unity Catalog. Previous AWS-to-Azure integration experience is a plus.

Qualifications

• 5+ years of experience in data/platform engineering or cloud data services.
• Strong knowledge of Azure Databricks and data lake architectures.
• Experience with Terraform and IaC practices.

Responsibilities

• Manage and optimize Azure Databricks platform operations.
• Enable AI features such as Model Serving, Vector Search, Lakebase, and MCP Server.
• Implement IaC with Terraform and automate tasks using Bash/PowerShell.

Skills

Azure Databricks

Platform administration

Terraform

Automation scripting

Bash

PowerShell

Azure DevOps

Git CI/CD

Security governance

Spark

Delta Lake

Unity Catalog

Lakehouse

AWS to Azure

AI/LLM platform

Job description

XPT Software Australia Pty Ltd is seeking a Senior Azure Databricks Platform Engineer (5+ years) to join our platform team in Sydney. You will enhance AI capabilities within Azure Databricks, manage platform operations, and drive automation and security best practices.

Key areas include Terraform-based infrastructure, CI/CD with Azure DevOps, and data-lake technologies such as Spark, Delta Lake, and Unity Catalog. Previous AWS-to-Azure integration experience is a plus.