Multiple Data Engineer

Recruitment Hive; Canberra; On-site; AUD 110,000 - 170,000; Full time

Job summary

The Recruitment Hive is seeking multiple Data Engineers on a 12-month contract to support a newly formed Government Organisation focused on environment, climate change and resources. The role requires Databricks, PySpark and Azure cloud expertise and is based in Canberra with 12-month contracting potential.

Immediate start and a baseline security clearance are preferred. Responsibilities include building enterprise data pipelines, Lakehouse architectures, data ingestion, and quality, with

Qualifications

• Experience integrating data from APIs, databases and SaaS platforms.
• Cloud experience with Azure, ADLS Gen2 and data factories.
• DevOps practices with Git, CI/CD and automated testing.
• Significant Databricks data engineering experience and SQL.
• Strong PySpark, Spark SQL and Python skills.
• Experience with Delta Lake, Unity Catalog and Databricks SQL.

Responsibilities

• Design, develop and maintain enterprise-scale data pipelines using Databricks.
• Build and optimise Lakehouse architectures with Delta Lake and Medallion patterns.
• Develop data ingestion frameworks for structured, semi-structured and unstructured data sources.
• Create scalable data transformation processes using PySpark, Spark SQL and Python.
• Implement data quality, lineage, monitoring and observability capabilities.

Skills

Data integration

Azure cloud

DevOps

Databricks

PySpark / Python

Databricks SQL

Tools

Databricks

Git

Azure Data Factory

Job description

12 + 12 + 12 Month contract - ASAP Start
Baseline Security Clearance
ACT, VIC, NSW, QLD

Our client, a newly formed Government Organisation, whose focus is to project Australia's natural environment and heritage sites as well as our response to climate change and water / energy resources, require the services of Multiple Data Engineers.

Duties of the Data Engineers

• Design, develop and maintain enterprise-scale data pipelines and ELT/ETL solutions using Databricks;
• Build and optimise Lakehouse architectures using Delta Lake and Medallion design patterns;
• Develop data ingestion frameworks for structured, semi-structured and unstructured data sources;
• Create scalable data transformation processes using PySpark, Spark SQL and Python;
• Implement data quality, lineage, monitoring and observability capabilities.

Skills and Experience Required

• Experience integrating data from APIs, databases, SaaS platforms and enterprise systems;
• Knowledge of cloud platforms such as Microsoft Azure, including ADLS Gen2, Azure Data Factory and Microsoft Fabric;
• Experience implementing DevOps practices using Git, CI/CD pipelines and automated testing;
• Significant experience designing and implementing solutions on the Databricks Data Intelligence Platform;
• Advanced proficiency in PySpark, Spark SQL, Python and SQL;
• Experience with Databricks Workflows, Delta Lake, Unity Catalog and Databricks SQL.

Please note, applications close on Wednesday, 02 September 2026 at midday, Canberra time.

Job ID GP 677680 | LH-07514

We Value Diversity

The Recruitment Hive is a proud Equal Opportunity Employer. We recognise the value of diverse perspectives and experience and are committed to an inclusive workplace where everyone feels valued and respected for who they are. We encourage people with disability, indigenous, veterans and people of all backgrounds and abilities to express their interest in this role.