Principal Data Engineer

Queensland Government; City of Brisbane; Hybrid; AUD 120,000 - 160,000; Full time

Benefits offered by this job

Flexible work options

Paid parental leave

Study assistance

Health and wellbeing program

Job summary

Crime and Corruption Commission Queensland is seeking a qualified Data Engineer to design and maintain data pipelines on Azure, ensuring data quality and supporting analytics and ML workflows. The role emphasizes secure data handling and collaboration with data analysts.

The successful candidate will work within an environment that values integrity, accountability and excellence, and benefits from flexible work options and a supportive learning culture.

Qualifications

• Two years of demonstrated experience in data engineering.
• Experience with Azure Data Factory, Azure SQL, Azure Data Lake, and Azure App Service.
• Understanding of data warehouse modelling principles (Kimball, Inmon).

Skills

Azure Data Factory

Azure SQL

Azure Data Lake

Azure App Service

Data pipelines

Data quality testing

Data modelling

Kimball

Inmon

Azure Monitoring

Education

Bachelor's degree in data engineering / data science / IT

Tools

Azure DevOps

Terraform

CI/CD

Infrastructure as Code

Power BI

Job description

About usWe have a vision that our communities will be safe and supported by fair and ethical public institutions with a focus on those matters of highest threat to the Queensland community. As an organisation we are committed to this vision and as such our values of people, accountability, integrity, courage and excellence underpin everything we do at the CCC.What we offerAt the CCC our people have access to a range of employee benefits that promote career development, enhance employee wellbeing and encourage a healthy and balanced work and home life. When you join the CCC you can access the following benefits:- salary packaging- 12.75% superannuation- flexible work options, including working from home- access to paid parental leave- accrued time off- opportunity to purchase leave- 17.5% annual leave loading- health and wellbeing program- study assistance- access to a wide variety of training opportunities- free annual influenza vaccination- six star rated inner city location close to public transportAbout youAppointments in the CCC are merit-based and will be assessed by looking at what you have done previously, the knowledge, skills and experience you have built, your potential for development, and your personal qualities which align with the leadership competencies and the CCC's values.Possession of tertiary qualifications relevant to the role is highly desirable (e.g. Data engineering, data science, information technology etc). Qualifications acquired from an overseas educational institution will only be accepted where the qualification has been recognised to an equivalent level in accordance with the Australian Qualifications Framework.For this role, we will consider how well you demonstrate the following:Essential Experience:At least two years of demonstrated experience in data engineering.Experience with Azure Data Factory, Azure SQL, Azure Data Lake, and Azure App Service is required.Building and maintaining data pipelines for data integration, processing and ensuring data quality and accuracy through testing and validations.Ability to work with structured, unstructured, and semi-structured data.Understanding of common data warehouse modelling and schema design principles, including Kimball, and Inmon.Experience monitoring and maintaining data warehouse (Azure platform) environments, including defining optimisation approaches to improve security, performance or cost.Demonstrated experience supporting machine learning workflows by building scalable data pipelines, enabling feature engineering, and collaborating with data analysts to deploy and integrate models within data infrastructure.Beneficial Experience:Good communication skills, including effective report writing, and the ability to verbally brief stakeholders.Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is preferred.Experience with machine learning and business intelligence is highly regarded.Experience in deploying applications into production environments with code packaging, testing, deployment, and release management.Experience working in an environment with strict information security and privacy requirements.A versatile team player excelling in both independent work and collaborative efforts within a team to achieve objectives.How to applyFor more detailed information, including what is required to demonstrate your suitability for the role, refer to the attached role description. Pre-employment vetting forms a part of our selection process - you may be asked to provide detailed personal particulars and private interests information. For more information about our security vetting process please refer to How to apply | CCC - Crime and Corruption Commission QueenslandAboriginal and Torres Strait Islander peoples are encouraged to apply.This work is licensed under a Creative Commons Attribution 3.0 Australia License.