Databricks Data Engineer — Hybrid (Up to 2 Days WFH)

NHVR External Careers; City of Brisbane; Hybrid; AUD 120,000 - 150,000; Full time

Benefits offered by this job

Hybrid working

Salary package + superannuation

Wellbeing programs

Training and development

Discount IT products

Job summary

NHVR is seeking a Data Engineer to join its Data & Technology team in Brisbane. You will design, build, and maintain scalable data pipelines using Databricks, Python, and Spark SQL, and contribute to governance and analytics initiatives across the organisation.

You will work in a Scrum environment, collaborate on BI/analytics, and support data security with Unity Catalog while improving performance and cost management. Hybrid work up to 2 days from home.

Qualifications

• Four+ years of data engineering experience with Databricks or similar cloud platform.
• Bachelor's degree in a relevant field desirable.
• Experience with Agile Scrum, SDLC, and data lifecycle processes.
• Hands-on Databricks experience with notebooks and Jobs/Workflows.
• Strong Python and PySpark pipelines with advanced SQL.
• Experience with Delta Lake features such as MERGE and VACUUM.
• Experience with Unity Catalog security and governance.
• Knowledge of metadata-driven or configuration-driven pipelines.
• Data modeling knowledge (relational, dimensional, medallion).

Responsibilities

• Collaborate in a Scrum team to deliver BAU work and roadmap milestones.
• Design, build and maintain scalable data pipelines in Databricks.
• Optimize performance and cost through cluster configuration and tuning.
• Implement and manage Unity Catalog security and data masking.
• Support incident management, monitoring, and troubleshooting.
• Proactively document risks and impediments for stakeholders.

Skills

Databricks

Python

Spark SQL

SQL

Agile/Scrum

CI/CD

Data governance

Data modeling

Security/compliance

Education

Bachelor's degree in a relevant field

Tools

Delta Lake

Unity Catalog

Lakeflow

ADLS Gen2

Key Vault

Git

Job description

NHVR is seeking a Data Engineer to join its Data & Technology team in Brisbane. You will design, build, and maintain scalable data pipelines using Databricks, Python, and Spark SQL, and contribute to governance and analytics initiatives across the organisation.

You will work in a Scrum environment, collaborate on BI/analytics, and support data security with Unity Catalog while improving performance and cost management. Hybrid work up to 2 days from home.