Lead Azure Data Engineer

Vincere; Canberra; Hybrid; AUD 120,000 - 160,000; Full time

Job summary

Resolve Recruit partners with a leading Commonwealth Government agency to fill a Lead Azure Data Engineer role in Canberra. The position focuses on Azure and Databricks data solutions to prepare data for decision-making and analytics across the organisation.

You will work in an Agile environment with a multidisciplinary team, applying your technical expertise and collaborative approach to design, develop and test data movement, transformation and visualization processes that make a real

Qualifications

• Experience developing ETL/ELT processes for complex or large-scale data movement, transformation or visualisation in cloud environments.
• Experience preparing data optimised for query performance in cloud compute engines such as Spark or Azure SQL.

Responsibilities

• Design, build and maintain ETL and ELT data ingest and transformation solutions to meet current and emerging needs.
• Create and maintain automated ingest and transformation patterns and frameworks.
• Prepare data in formats such as Parquet and Delta to support advanced analytics and AI use cases.
• Develop and test data visualisations in Power BI that present complex information clearly for different audiences.
• Collaborate with project and multidisciplinary teams to deliver outcomes aligned with organisational priorities.
• Support and mentor data engineers through regular quality reviews and constructive feedback.

Skills

ETL/ELT pipelines

Azure ecosystems

Databricks

Data visualization

Agile / collaboration

Mentoring

DevOps familiarity

SQL / Azure SQL

5 years data engineering

Education

Data engineering qualifications or training

Tools

Azure Data Factory

SQL Server Integration Services

Databricks

SQL Server

Data Lake Storage

Azure Machine Learning

ArcGIS Enterprise

Spark

Job description

• 12 + 12 + 12-month contract with a key Commonwealth Government agency
• Canberra based role with hybrid working arrangements
• NV1 security clearance preferred
• Lead Azure and Databricks data solutions for a Commonwealth Government agency

Resolve Recruit is partnering with a leading Commonwealth Government agency to find a Lead Azure Data Engineer. Our client uses modern cloud technology, including Azure and Databricks, to prepare data that supports decision-making and operational analytics across the organisation. This is a chance to shape the design, development and testing of data movement, transformation and visualisation processes that make a real difference.

In this role, you will work alongside a multidisciplinary team in an Agile environment, bringing your technical expertise, initiative and collaborative approach to every project.

Key Responsibilities

• Design, build and maintain ETL and ELT data ingest and transformation solutions to meet current and emerging needs
• Create and maintain automated ingest and transformation patterns and frameworks
• Prepare data in formats such as Parquet and Delta to support advanced analytics and AI use cases
• Develop and test data visualisations in Power BI that present complex information clearly for different audiences
• Collaborate with project and multidisciplinary teams to deliver outcomes aligned with organisational priorities
• Support and mentor data engineers through regular quality reviews and constructive feedback

Key Experience and Skills

• Demonstrated experience developing ETL/ELT processes for complex or large-scale data movement, transformation or visualisation, particularly in cloud environments
• Experience preparing data optimised for query performance in cloud compute engines, such as Spark, graph databases or Azure SQL
• Experience with engineering, storage and analytics services in the cloud, including Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Data Lake Storage, Azure Machine Learning and ArcGIS Enterprise
• Familiarity with DevOps and Visual Studio, and with sourcing data from systems such as Oracle, Ingres and SQL Server (knowledge of Data Lakes and Lakehouses is highly regarded)
• Relevant qualifications or training in data engineering techniques, and around five years' experience as a data engineer
• Clear communication, relationship-building and negotiation skills, with a collaborative, adaptable approach

Security Requirements

Applicants will ideally hold a minimum Negative Vetting Level 1 Security Clearance (or higher) to be considered.