Lead Data Engineer

Ingrity Pty; Canberra; Híbrido; AUD 140.000 - 170.000; Jornada completa

Descripción de la vacante

INGRITY is seeking a Lead Data Engineer to steer data ingestion, transformation and visualization solutions for a federal government department, across Azure and Databricks.

The role emphasizes preparing data for analytics and AI use cases, quality assurance, and collaboration with cross-functional delivery teams within an established agile environment.

Formación

• Five+ years of data engineering experience
• Experience with large-scale ETL/ELT
• Cloud data engineering in Azure
• Knowledge of Parquet/Delta formats
• Strong communication and collaboration

Responsabilidades

• Design, build and test data ingestion and transformation solutions across Azure and Databricks.
• Develop reusable ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualization and AI use cases with focus on quality and performance.
• Support data engineers across delivery teams through reviews and feedback.
• Collaborate with project teams to deliver outcomes aligned with priorities.
• Participate in agile delivery and attend quarterly ceremonies and team events.

Conocimientos

Data engineering

ETL/ELT

Azure

Databricks

Data Lakes

Parquet/Delta

Power BI

Communication

Educación

Relevant qualifications

Herramientas

Azure Data Factory

SSIS

SQL Server

Azure ML

Azure DevOps

Visual Studio

Descripción del empleo

Lead Data Engineer - Federal Government

Location: Canberra CBD, ACT | Hybrid

Engagement: 12-month contract, with two possible 12-month extensions

About INGRITY

INGRITY is a specialist Data, Digital, Cloud & AI consultancy, helping organisations turn complex data into practical business outcomes.

We're looking for an experienced Lead Data Engineer to support a federal government department's enterprise analytics and technology services team.

About The Role

You'll lead the design, build and testing of data ingestion, transformation and visualisation solutions across Azure and Databricks, preparing data to support decision-making across the department.

What You'll Do

• Design, build, test and maintain data ingestion and transformation solutions that meet current and emerging needs.
• Develop reusable, automated ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualisation and AI use cases, with a focus on quality and query performance.
• Support data engineers across delivery teams through quality reviews and constructive feedback.
• Collaborate with project teams to deliver outcomes aligned with departmental and program priorities.
• Participate in agile delivery, including in-person attendance at quarterly agile ceremonies and key team events.

What We're Looking For

• Data engineering experience: At least five years' experience as a data engineer, supported by relevant qualifications or training.
• ETL and ELT delivery: Strong experience developing solutions for large or complex data movement, transformation and visualisation, particularly in cloud environments.
• Azure technology expertise: Experience across Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Azure Data Lake Storage, Azure Machine Learning, Azure DevOps and Visual Studio.
• Performance optimisation: Experience preparing data for efficient querying in cloud compute engines, including Spark, graph databases and Azure SQL.
• Automated ingestion: Experience sourcing and ingesting data from Oracle, Ingres, Azure and SQL Server environments.
• Analytics-ready data: Experience transforming data into Parquet and Delta formats for advanced analytics and AI use cases.
• Power BI: Ability to analyse complex datasets and design visualisations suited to the intended audience.
• Communication and collaboration: Strong written and verbal communication, relationship-building and negotiation skills.

Nice to Have

• Experience using Azure Data Factory and Databricks together.
• Knowledge of data lake and lakehouse architectures.
• Experience with ArcGIS Enterprise.

Why Join?

• Deliver data engineering solutions that support decision-making across a federal government department.
• Work across Azure and Databricks within an established agile team.
• Combine hands-on engineering with technical leadership and quality oversight.
• Secure a 12-month engagement with the possibility of two further 12-month extensions.

Citizenship and Security Clearance

Applicants must be Australian citizens and hold, or be eligible and willing to obtain, Negative Vetting Level 1 (NV1) clearance.