Lead Data Engineer

Ingrity Pty; Canberra; Hybrid; AUD 150.000 - 190.000; Vollzeit

Zusammenfassung

INGRITY is seeking an experienced Lead Data Engineer to support a federal government department’s enterprise analytics and technology services team. You’ll design, build and test data ingestion, transformation and visualization solutions across Azure and Databricks to enable data-driven decision-making.

The role requires at least five years’ data engineering experience, strong cloud ETL/ELT capabilities, and proficiency with Azure services and Power BI.

Qualifikationen

• At least five years’ data engineering experience with relevant qualifications or training.
• Strong experience delivering large or complex data movement, transformation and visualisation in cloud environments.
• Experience across Azure Data Factory, Databricks, SQL Server and related Azure services.
• Experience preparing data for efficient querying in cloud compute engines (Spark, Azure SQL).
• Experience sourcing data from Oracle, Ingres, Azure and SQL Server environments.
• Experience transforming data into Parquet and Delta formats for analytics/AI use cases.
• Ability to analyse complex datasets and design visualisations for the audience.
• Strong written and verbal communication, relationship-building and negotiation skills.

Aufgaben

• Design, build, test and maintain data ingestion and transformation solutions across Azure and Databricks.
• Develop reusable automated ingestion and transformation patterns.
• Prepare data for analytics, visualization and AI use cases with focus on quality and performance.
• Support data engineers through quality reviews and feedback.
• Collaborate with project teams to deliver outcomes aligned with priorities.
• Participate in agile delivery and team ceremonies.

Kenntnisse

Data engineering

ETL/ELT

Azure

Performance optimization

Automated ingestion

Analytics-ready data

Power BI

Communication

Ausbildung

Relevant qualifications

Tools

Azure Data Factory

SSIS

Databricks

SQL Server

Azure Data Lake Storage

Azure Machine Learning

Azure DevOps

Visual Studio

Jobbeschreibung

Lead Data Engineer – Federal Government

Location: Canberra CBD, ACT | Hybrid
Engagement: 12-month contract, with two possible 12-month extensions

About INGRITY

INGRITY is a specialist Data, Digital, Cloud & AI consultancy, helping organisations turn complex data into practical business outcomes.

We’re looking for an experienced Lead Data Engineer to support a federal government department’s enterprise analytics and technology services team.

About the Role

You’ll lead the design, build and testing of data ingestion, transformation and visualisation solutions across Azure and Databricks, preparing data to support decision-making across the department.

What You’ll Do

• Design, build, test and maintain data ingestion and transformation solutions that meet current and emerging needs.
• Develop reusable, automated ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualisation and AI use cases, with a focus on quality and query performance.
• Support data engineers across delivery teams through quality reviews and constructive feedback.
• Collaborate with project teams to deliver outcomes aligned with departmental and program priorities.
• Participate in agile delivery, including in-person attendance at quarterly agile ceremonies and key team events.

What We’re Looking For

• Data engineering experience: At least five years’ experience as a data engineer, supported by relevant qualifications or training.
• ETL and ELT delivery: Strong experience developing solutions for large or complex data movement, transformation and visualisation, particularly in cloud environments.
• Azure technology expertise: Experience across Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Azure Data Lake Storage, Azure Machine Learning, Azure DevOps and Visual Studio.
• Performance optimisation: Experience preparing data for efficient querying in cloud compute engines, including Spark, graph databases and Azure SQL.
• Automated ingestion: Experience sourcing and ingesting data from Oracle, Ingres, Azure and SQL Server environments.
• Analytics-ready data: Experience transforming data into Parquet and Delta formats for advanced analytics and AI use cases.
• Power BI: Ability to analyse complex datasets and design visualisations suited to the intended audience.
• Communication and collaboration: Strong written and verbal communication, relationship-building and negotiation skills.

Nice to Have

• Experience using Azure Data Factory and Databricks together.
• Knowledge of data lake and lakehouse architectures.
• Experience with ArcGIS Enterprise.

Why Join?

• Deliver data engineering solutions that support decision-making across a federal government department.
• Work across Azure and Databricks within an established agile team.
• Combine hands-on engineering with technical leadership and quality oversight.
• Secure a 12-month engagement with the possibility of two further 12-month extensions.

Citizenship and Security Clearance

Applicants must be Australian citizens and hold, or be eligible and willing to obtain, Negative Vetting Level 1 (NV1) clearance.

Be careful - Don’t provide your bank or credit card details when applying for jobs. Don't transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad .