Cloud Data Engineer (Databricks) - Flexible & AI-Ready

Comparethemarket; Brisbane; Hybrid; AUD 110,000 - 160,000; Full time

Benefits offered by this job

Vibrant and social community events

Flexible work arrangements (one day Wf

9-day fortnight

ME leave and Volunteer Day leave

Free coffee on Mondays

Purchase of additional leave

Return To Work bonus for returning

Quarterly Award and Recognition

Job summary

Compare the Market and iSelect are seeking a Data Engineer to design, build and maintain scalable cloud data solutions using Databricks and related platforms. You will deliver robust data pipelines and lakehouse architectures to support reporting, analytics and AI/ML initiatives.

Collaborate with analysts, data scientists and engineers to transform raw data into trusted information while ensuring governance, quality and reliability of the enterprise data platform.

Qualifications

• Degree in Computer Science, Analytics, IT or related field, or equivalent practical experience.
• 3+ years in Data Engineering, or 5+ years across engineering, data or BI.
• 3+ years with cloud platforms such as AWS, Azure or GCP and Lakehouse technologies including Databricks, Snowflake, BigQuery, Redshift or Synapse.

Responsibilities

• Design and build scalable cloud data solutions aligned with enterprise architecture and governance standards.
• Build and optimise end-to-end data pipelines, integrations and workflows.
• Implement, test and deploy solutions using IaC, engineering best practices and release processes.
• Ensure data quality and reliability through monitoring, logging, issue remediation and proactive risk management.
• Partner with Solution Architects, Data Engineers, BI Developers and business stakeholders to optimise platforms and support analytics.
• Work effectively in an Agile environment, bringing strong communication, business knowledge and an end-to-end understanding of the Data & Insights lifecycle.
• Apply data engineering best practices and advance DataOps and automation to continually improve platform performance and scalability.

Skills

3+ years in Data Engineering

5+ years across eng/data/BI

3+ years with cloud platforms (AWS/AZ/

Databricks/Snowflake/BigQuery/Synapse

Spark/Python/SQL

DataOps/Orchestration (Airflow, DBT)

Education

Degree in Computer Science, Analytics, IT or related

Tools

Databricks

Snowflake

BigQuery

Redshift

Synapse

Airflow

Job description

Compare the Market and iSelect are seeking a Data Engineer to design, build and maintain scalable cloud data solutions using Databricks and related platforms. You will deliver robust data pipelines and lakehouse architectures to support reporting, analytics and AI/ML initiatives.

Collaborate with analysts, data scientists and engineers to transform raw data into trusted information while ensuring governance, quality and reliability of the enterprise data platform.