Azure Databricks Production Support Engineer

Ingrity; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Job summary

Ingrity is seeking an experienced Azure / Databricks Application Support Engineer to join a major financial services client in Melbourne or a flexible location. You will support a production Azure/Databricks data environment, troubleshoot issues, and manage deployments and infrastructure.

Collaborate with technical and business stakeholders, maintain data pipelines, and ensure system reliability with CI/CD practices and robust DevOps tooling.

Qualifications

• Strong hands-on experience with Azure and Databricks.
• Experience across Azure SQL, Cosmos DB, Azure Data Factory, Blob Storage, Key Vault and Azure DevOps.
• Strong Databricks knowledge including jobs, pipelines, notebooks, clusters, volumes, catalog/schema management and permissions.
• Good understanding of Lakehouse and Medallion Architecture, including ELT workloads using dbt.
• Strong knowledge of Spark / PySpark / SparkSQL, including Spark internals and using Spark UI for performance troubleshooting.
• Experience with Terraform, Git/GitOps, YAML, JSON and Shell/Bash/PowerShell.
• Monitoring and troubleshooting experience using Azure Log Analytics and Splunk.
• Strong production support capability including root cause analysis, performance/resource analysis, data reconciliation and incident resolution.
• Experience managing CI/CD pipelines, deployment dependencies, secrets/credential rotation and DR/failover processes.
• Comfortable managing integrations and connections across APIs, JDBC and direct connectivity.
• Strong communication skills with the ability to provide clear reporting and updates to business and technical stakeholders.

Responsibilities

• You'll be responsible for supporting and maintaining a production Azure/Databricks data environment.
• Troubleshooting issues, managing deployments and infrastructure.
• Working closely with technical and business stakeholders.

Skills

Azure

Databricks

Cloud data platforms

SQL/DB knowledge

Azure DevOps

dbt

Spark / PySpark / SparkSQL

Terraform

Git/GitOps

Shell/Bash/PowerShell

REST APIs

Tools

Azure

Databricks

Azure SQL

Cosmos DB

Azure Data Factory

Blob Storage

Key Vault

Azure DevOps

dbt

Spark UI

Terraform

Git

YAML

JSON

Shell

PowerShell

Azure Log Analytics

Splunk

CI/CD pipelines

APIs

JDBC

Job description

Ingrity is seeking an experienced Azure / Databricks Application Support Engineer to join a major financial services client in Melbourne or a flexible location. You will support a production Azure/Databricks data environment, troubleshoot issues, and manage deployments and infrastructure.

Collaborate with technical and business stakeholders, maintain data pipelines, and ensure system reliability with CI/CD practices and robust DevOps tooling.