Data Engineer

Data#3; Brisbane; Hybrid; AUD 110,000 - 150,000; Full time

Job summary

Data#3 is seeking a Data Engineer to support a Data Platform project in a 12-month contract based in Brisbane CBD. The role is hybrid, with responsibilities spanning data ingestion, modelling, and governance to deliver analytics for Fines & SPER stakeholders.

You will work on large-scale data environments, building and maintaining pipelines, dashboards, and reports while ensuring platform stability and compliance with governance standards.

Qualifications

• 3+ years of hands-on experience in large-scale projects related to data warehousing, data lake, lakehouse, or analytical applications.
• Proficient in SQL, agile processes, data modelling, data engineering, and ELT development with Azure Databricks, ADF or Synapse.
• Experience delivering with Medallion Architecture and Layered Scalable Architecture (LSA++).

Responsibilities

• Conduct technical analysis and feasibility of business requirements.
• Develop solution design and maintain required technical documentation.
• Develop data ingestion pipelines from transactional systems to the MDP (Databricks platform).
• Develop data ingestion pipelines to load external agency data.
• Develop, test, and deploy analytical reports for business users.
• Understand and implement data governance in the platform.
• Provide platform support to ensure business continuity.

Skills

SQL

Agile

Data modeling

Data engineering

ELT development

Azure Databricks

ADF/Synapse

Tools

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Job description

The Data Engineer will be supporting the delivery of a Data Platform project. This is a 12 month initial contract and is a hybrid role based in Brisbane CBD.

Duties of the role

• Conduct technical analysis and feasibility of business requirements
• Develop solution design and maintain required technical documentation
• Develop data ingestion pipelines from various Fines & SPER transactional systems to QRO’s MDP (Databricks platform)
• Develop data ingestion pipelines to load external agency data (TMR, QPS, etc.)
• Develop, test, and deploy analytical reports consumed by Fines & SPER business users
• Understand, implement, and maintain data governance principles in MDP
• Provide platform support to ensure business / service continuity

Skills and Experience required

• At least 3 years of hands-on experience in large scale projects related to one or more of the following areas: Enterprise data warehouse, data lake, Lakehouse, analytical application.
• Understanding and working knowledge of SQL, agile process, data modelling, data engineering, ELT development with Azure Databricks, ADF/Synapse.
• Experience of technical delivery following Medallion Architecture and Layered Scalable Architecture (LSA++).