Principal Data Engineer

Crime and Corruption Commission QLD; City of Brisbane; Hybrid; AUD 110,000 - 150,000; Full time

Benefits offered by this job

Salary packaging

12.75% superannuation

Flexible work options

Paid parental leave

Accrued time off

Leave purchase

Annual leave loading 17.5%

Health and wellbeing program

Study assistance

Training opportunities

Flu vaccination

Inner city location near transport

Job summary

The Crime and Corruption Commission QLD is seeking a data engineer to design and maintain data pipelines, integrate Azure-based data services, and support ML workflows in a security-conscious public sector environment.

You will work with structured and unstructured data, implement data quality checks, and help optimise data warehouse designs (Kimball/Inmon) on Azure. A merit-based approach will guide appointment and development within a values-driven organisation.

Qualifications

• At least two years of demonstrated experience in data engineering.
• Experience with Azure Data Factory, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Building and maintaining data pipelines for data integration, processing and ensuring data quality and accuracy through testing and validations.
• Ability to work with structured, unstructured, and semi-structured data.
• Understanding of common data warehouse modelling and schema design principles, including Kimball, and Inmon.
• Experience monitoring and maintaining data warehouse (Azure platform) environments, including defining optimisation approaches to improve security, performance or cost.
• Demonstrated experience supporting machine learning workflows by building scalable data pipelines, enabling feature engineering, and collaborating with data analysts to deploy and integrate models within data infrastructure.

Responsibilities

Skills

Data engineering

Azure Data Factory

Azure SQL

Azure Data Lake

Data pipelines

Machine learning workflows

Data quality testing

Education

Tertiary qualifications in data engineering / data science / IT

Tools

Azure App Service

Azure Data Factory

Job description

Crime and Corruption Commission QLD – Fortitude Valley QLD

The Crime and Corruption Commission (CCC) is a statutory body set up to combat and reduce the incidence of major crime and corruption in the public sector in Queensland. Its functions and powers are set out in the Crime and Corruption Act 2001.

About us

We have a vision that our communities will be safe and supported by fair and ethical public institutions with a focus on those matters of highest threat to the Queensland community. As an organisation we are committed to this vision and as such our values of people, accountability, integrity, courage and excellence underpin everything we do at the CCC.

What we offer

• salary packaging
• 12.75% superannuation
• flexible work options, including working from home
• access to paid parental leave
• accrued time off
• opportunity to purchase leave
• 17.5% annual leave loading
• health and wellbeing program
• study assistance
• access to a wide variety of training opportunities
• free annual influenza vaccination
• six star rated inner city location close to public transport

About you

Appointments in the CCC are merit-based and will be assessed by looking at what you have done previously—the knowledge, skills and experience you have built, your potential for development, and your personal qualities which align with the leadership competencies and the CCC's values.

Possession of tertiary qualifications relevant to the role is highly desirable (e.g. Data engineering, data science, information technology etc). Qualifications acquired from an overseas educational institution will only be accepted where the qualification has been recognised to an equivalent level in accordance with the Australian Qualifications Framework.

For this role, we will consider how well you demonstrate the following:

• At least two years of demonstrated experience in data engineering.
• Experience with Azure Data Factory, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Building and maintaining data pipelines for data integration, processing and ensuring data quality and accuracy through testing and validations.
• Ability to work with structured, unstructured, and semi-structured data.
• Understanding of common data warehouse modelling and schema design principles, including Kimball, and Inmon.
• Experience monitoring and maintaining data warehouse (Azure platform) environments, including defining optimisation approaches to improve security, performance or cost.
• Demonstrated experience supporting machine learning workflows by building scalable data pipelines, enabling feature engineering, and collaborating with data analysts to deploy and integrate models within data infrastructure.

Beneficial Experience

• Good communication skills, including effective report writing, and the ability to verbally brief stakeholders.
• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is preferred.
• Experience with machine learning and business intelligence is highly regarded.
• Experience in deploying applications into production environments with code packaging, testing, deployment, and release management.
• Experience working in an environment with strict information security and privacy requirements.
• A versatile team player excelling in both independent work and collaborative efforts within a team to achieve objectives.

Aboriginal and Torres Strait Islander peoples are encouraged to apply.