Senior Data Engineer – Azure Data Platform & Pipelines

Crime and Corruption Commission; City of Brisbane; Hybrid; AUD 110,000 - 160,000; Full time

Benefits offered by this job

Salary packaging

Flexible work options

Parental leave

Accrued time off

Leave purchase

Leave loading

Wellbeing program

Training opportunities

Public transport access

Job summary

The Crime and Corruption Commission (CCC) Brisbane is seeking a data engineering specialist to design and maintain robust data pipelines across Azure-based services. You will ensure data integrity, support ML workflows and collaborate with analysts on sensitive public sector data.

Applicants should have tertiary qualifications in data IT and demonstrable experience with Azure Data Factory, Azure SQL and data warehousing concepts.

Qualifications

• Possession of tertiary qualifications relevant to the role is highly desirable (e.g. Data engineering, data science, information technology).
• Experience in data engineering and building data pipelines is required or highly desirable.
• Strong understanding of data warehousing concepts and modelling (Kimball/Inmon).
• Experience with Azure data services and data platform governance is expected.

Responsibilities

• Build and maintain data pipelines for data integration, processing and quality assurance.
• Work with structured, unstructured and semi-structured data.
• Monitor and optimise Azure data warehouse environments for security and cost.
• Collaborate with data analysts to deploy models and support ML workflows.

Skills

Data engineering

Azure Data Factory

Azure SQL

Azure Data Lake

Azure App Service

Data pipelines

Data quality

Data modelling

Kimball/Inmon

ML workflows

CI/CD

Education

Tertiary qualifications in data engineering/IT

Tools

Azure

SQL

Job description

The Crime and Corruption Commission (CCC) Brisbane is seeking a data engineering specialist to design and maintain robust data pipelines across Azure-based services. You will ensure data integrity, support ML workflows and collaborate with analysts on sensitive public sector data.

Applicants should have tertiary qualifications in data IT and demonstrable experience with Azure Data Factory, Azure SQL and data warehousing concepts.