Data Engineer - Cloud Data Pipelines & Lakehouse

Compare The Market; Brisbane; Presencial; AUD 110.000 - 170.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Annual celebrations

Flexible work options

ME leave

Volunteer day leave

Free coffee

Extra leave

Return-to-work bonus

Award program

Descripción de la vacante

Compare the Market is seeking a Data Engineer to design, build and maintain scalable cloud data solutions. You will deliver robust data pipelines, lakehouse architectures and automation frameworks to support reporting, analytics and AI initiatives.

You will collaborate with analysts, data scientists and engineers across an Agile team, focusing on governance, data quality and end-to-end DataOps practices while enabling efficient data access for stakeholders.

Formación

• Degree in Computer Science, Analytics, IT or a related field, or equivalent practical experience.

Responsabilidades

• Design scalable data solutions aligned with enterprise architecture and governance standards.
• Build and optimise end-to-end data pipelines, integrations and workflows.
• Implement, test and deploy solutions using IaC, engineering best practices and release processes.
• Ensure data quality and reliability through monitoring, logging, issue remediation and proactive risk management.
• Partner with Solution Architects, Data Engineers, BI Developers and business stakeholders to optimise platforms and support analytics.
• Work effectively in an Agile environment, bringing strong communication and end-to-end understanding of the Data & Insights lifecycle.
• Apply data engineering best practices and advance DataOps and automation to continually improve platform performance and scalability.

Conocimientos

Data engineering

Databricks

Spark

Python

SQL

ETL/ELT

Airflow

Data modeling

Governance

CI/CD

Educación

Degree in Computer Science

Herramientas

Databricks

Snowflake

BigQuery

Redshift

Synapse

AWS/Azure/GCP

Descripción del empleo

Compare the Market is seeking a Data Engineer to design, build and maintain scalable cloud data solutions. You will deliver robust data pipelines, lakehouse architectures and automation frameworks to support reporting, analytics and AI initiatives.

You will collaborate with analysts, data scientists and engineers across an Agile team, focusing on governance, data quality and end-to-end DataOps practices while enabling efficient data access for stakeholders.