Lead Data Engineer - Azure Data Platform & Pipelines

Crime and Corruption Commission QLD; City of Brisbane; Hybrid; AUD 110,000 - 150,000; Full time

Benefits offered by this job

Salary packaging

12.75% superannuation

Flexible work options

Paid parental leave

Accrued time off

Leave purchase

Annual leave loading 17.5%

Health and wellbeing program

Study assistance

Training opportunities

Flu vaccination

Inner city location near transport

Job summary

The Crime and Corruption Commission QLD is seeking a data engineer to design and maintain data pipelines, integrate Azure-based data services, and support ML workflows in a security-conscious public sector environment.

You will work with structured and unstructured data, implement data quality checks, and help optimise data warehouse designs (Kimball/Inmon) on Azure. A merit-based approach will guide appointment and development within a values-driven organisation.

Qualifications

• At least two years of demonstrated experience in data engineering.
• Experience with Azure Data Factory, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Building and maintaining data pipelines for data integration, processing and ensuring data quality and accuracy through testing and validations.
• Ability to work with structured, unstructured, and semi-structured data.
• Understanding of common data warehouse modelling and schema design principles, including Kimball, and Inmon.
• Experience monitoring and maintaining data warehouse (Azure platform) environments, including defining optimisation approaches to improve security, performance or cost.
• Demonstrated experience supporting machine learning workflows by building scalable data pipelines, enabling feature engineering, and collaborating with data analysts to deploy and integrate models within data infrastructure.

Responsibilities

Skills

Data engineering

Azure Data Factory

Azure SQL

Azure Data Lake

Data pipelines

Machine learning workflows

Data quality testing

Education

Tertiary qualifications in data engineering / data science / IT

Tools

Azure App Service

Azure Data Factory

Job description

The Crime and Corruption Commission QLD is seeking a data engineer to design and maintain data pipelines, integrate Azure-based data services, and support ML workflows in a security-conscious public sector environment.

You will work with structured and unstructured data, implement data quality checks, and help optimise data warehouse designs (Kimball/Inmon) on Azure. A merit-based approach will guide appointment and development within a values-driven organisation.