Lead Data Engineer

Ingrity Pty; Canberra; Hybrid; AUD 180.000 - 260.000; Vollzeit

Zusammenfassung

INGRITY is seeking a Lead Data Engineer to lead design, build, and testing of data ingestion, transformation and visualization solutions across Azure and Databricks. You will prepare data to support decision-making for a federal government department and drive quality, performance and scalability.

You will lead delivery efforts within an established agile team, collaborating with project teams and providing technical leadership and quality oversight.

Qualifikationen

• 5+ years data engineering experience with relevant qualifications or training.
• Experience delivering large/complex data movement, transformation and visualization in cloud environments.
• Hands-on Azure data tooling and data processing stack experience required.

Aufgaben

• Design, build, test and maintain data ingestion and transformation solutions for current and emerging needs.
• Develop reusable, automated ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualization and AI use cases with focus on quality and performance.
• Support other data engineers with quality reviews and feedback.
• Collaborate with project teams to deliver outcomes aligned with departmental priorities.
• Participate in agile delivery and attend quarterly ceremonies and key team events.

Kenntnisse

Data engineering

ETL/ELT

Azure expertise

Performance tuning

Automated ingestion

Analytics-ready data

Power BI

Communication

Tools

Azure Data Factory

SQL Server Integration Services

Databricks

SQL Server

Azure Data Lake Storage

Azure Machine Learning

Azure DevOps

Visual Studio

Jobbeschreibung

Lead Data Engineer

Location: Canberra CBD, ACT | Hybrid
Engagement: 12-month contract, with two possible 12-month extensions

About INGRITY:

INGRITY is a specialist Data, Digital, Cloud & AI consultancy, helping organisations turn complex data into practical business outcomes. We’re looking for an experienced Lead Data Engineer to support a federal government department’s enterprise analytics and technology services team.

About the Role:

You’ll lead the design, build and testing of data ingestion, transformation and visualisation solutions across Azure and Databricks, preparing data to support decision-making across the department.

What You’ll Do:

• Design, build, test and maintain data ingestion and transformation solutions that meet current and emerging needs.
• Develop reusable, automated ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualisation and AI use cases, with a focus on quality and query performance.
• Support data engineers across delivery teams through quality reviews and constructive feedback.
• Collaborate with project teams to deliver outcomes aligned with departmental and program priorities.
• Participate in agile delivery, including in-person attendance at quarterly agile ceremonies and key team events.

What We’re Looking For:

• Data engineering experience: At least five years’ experience as a data engineer, supported by relevant qualifications or training.
• ETL and ELT delivery: Strong experience developing solutions for large or complex data movement, transformation and visualisation, particularly in cloud environments.
• Azure technology expertise: Experience across Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Azure Data Lake Storage, Azure Machine Learning, Azure DevOps and Visual Studio.
• Performance optimisation: Experience preparing data for efficient querying in cloud compute engines, including Spark, graph databases and Azure SQL.
• Automated ingestion: Experience sourcing and ingesting data from Oracle, Ingres, Azure and SQL Server environments.
• Analytics-ready data: Experience transforming data into Parquet and Delta formats for advanced analytics and AI use cases.
• Power BI: Ability to analyse complex datasets and design visualisations suited to the intended audience.
• Communication and collaboration: Strong written and verbal communication, relationship-building and negotiation skills.

Nice to Have:

• Experience using Azure Data Factory and Databricks together.
• Knowledge of data lake and lakehouse architectures.
• Experience with ArcGIS Enterprise.

Why Join?:

• Deliver data engineering solutions that support decision-making across a federal government department.
• Work across Azure and Databricks within an established agile team.
• Combine hands-on engineering with technical leadership and quality oversight.
• Secure a 12-month engagement with the possibility of two further 12-month extensions.

Citizenship and Security Clearance:

Applicants must be Australian citizens and hold, or be eligible and willing to obtain, Negative Vetting Level 1 (NV1) clearance.