Azure Databricks Production & Data Platform Engineer

Ingrity Pty; City of Melbourne; On-site; AUD 110,000 - 170,000; Full time

Job summary

Ingrity Pty seeks an experienced Azure / Databricks Application Support Engineer to support a production data environment in a financial services context. The role focuses on troubleshooting, deployments, and collaboration with tech and business stakeholders.

The candidate will maintain Azure Databricks workloads, leverage Azure services, and drive CI/CD and DR processes across the platform. Melbourne-based with flexibility for other locations.

Qualifications

• Strong hands-on experience with Azure and Databricks within production/application support environments.
• Experience across Azure SQL, Cosmos DB, Azure Data Factory, Blob Storage, Key Vault and Azure DevOps.
• Strong Databricks knowledge including jobs, pipelines, notebooks, clusters, volumes, catalog/schema management and permissions.
• Good understanding of Lakehouse and Medallion Architecture, including ELT workloads using dbt.
• Strong knowledge of Spark / PySpark / SparkSQL, including Spark internals and using Spark UI for performance troubleshooting.
• Experience with Terraform, Git/GitOps, YAML, JSON and Shell/Bash/PowerShell.
• Monitoring and troubleshooting experience using Azure Log Analytics and Splunk.
• Strong production support capability including root cause analysis, performance/resource analysis, data reconciliation and incident resolution.
• Experience managing CI/CD pipelines, deployment dependencies, secrets/credential rotation and DR/failover processes.
• Comfortable managing integrations and connections across APIs, JDBC and direct connectivity.
• Strong communication skills with the ability to provide clear reporting and updates to business and technical stakeholders.

Responsibilities

• Provide ongoing Azure/Databricks production support and issue resolution.
• Troubleshoot deployments and manage cloud infrastructure changes.
• Collaborate with stakeholders to ensure stable data pipelines and Lakehouse environments.
• Operate CI/CD pipelines and manage deployment dependencies and secret rotation.
• Support DR/failover testing and data reconciliation activities.
• Communicate status updates clearly to technical and business teams.

Skills

Azure

Databricks

Application Support

Azure DevOps

Spark / PySpark

Terraform

Git/GitOps

Shell/PowerShell

Tools

Azure SQL

Cosmos DB

Azure Data Factory

Blob Storage

Key Vault

dbt

Job description

Ingrity Pty seeks an experienced Azure / Databricks Application Support Engineer to support a production data environment in a financial services context. The role focuses on troubleshooting, deployments, and collaboration with tech and business stakeholders.

The candidate will maintain Azure Databricks workloads, leverage Azure services, and drive CI/CD and DR processes across the platform. Melbourne-based with flexibility for other locations.