Data Engineer - Databricks, PySpark & Lakeflow (Hybrid)

HIGGINS; Brisbane; Hybrid; AUD 122,000 - 150,000; Full time

Benefits offered by this job

Hybrid work up to 2 days from home

Salary package with superannuation

Leave over Christmas closure

Wellbeing programs and discounts

Professional development support

Job summary

NHVR is seeking a Data Engineer to provide a data-driven, governance-focused role within the Data & Technology teams. You will build robust data pipelines, ensure security and compliance, and work with modern Databricks capabilities to transform data into actionable insights.

The role requires strong Databricks and Python skills, experience with Unity Catalog, Delta Lake, and CI/CD. Hybrid work up to 2 days from home is available in a Brisbane-based team.

Qualifications

• Hands-on Databricks experience with notebooks and Jobs/Workflows.
• Strong Python and PySpark data pipeline development skills with advanced SQL.
• Practical experience with Delta Lake features and data governance.

Responsibilities

• Collaborate in a Scrum team to deliver BAU and roadmap milestones.
• Interpret requirements, estimate workloads, prioritise tasks and manage time.
• Design, build and maintain scalable data pipelines in Databricks using Python and Spark SQL.
• Operate Databricks notebooks and jobs, optimize performance and cost.
• Extend framework for new data sources and onboard quickly.
• Contribute to Lakeflow declarative pipelines and modern Databricks capabilities.
• Deliver changes via CI/CD, source control, tests, code reviews and CAB releases.
• Support and upgrade existing workflows and deployment pipelines.
• Implement and manage data security with Unity Catalog and access controls.
• Identify and protect sensitive/PII data with tagging and masking.
• Participate in incident management and root cause analyses.

Skills

Databricks

Python

PySpark

Spark SQL

Delta Lake

Unity Catalog

Azure data services

CI/CD

Git

SQL (Spark/T-SQL)

Education

Bachelor's degree in a relevant field

Tools

Lakeflow

Auto Loader

Databricks notebooks

PowerBI/Tableau (optional)

Job description

NHVR is seeking a Data Engineer to provide a data-driven, governance-focused role within the Data & Technology teams. You will build robust data pipelines, ensure security and compliance, and work with modern Databricks capabilities to transform data into actionable insights.

The role requires strong Databricks and Python skills, experience with Unity Catalog, Delta Lake, and CI/CD. Hybrid work up to 2 days from home is available in a Brisbane-based team.