Lead Data Platform Engineer & AI Innovation

Compare the Market Australia; Brisbane; Hybrid; AUD 210,000 - 270,000; Full time

Benefits offered by this job

Annual celebrations

Flexible work arrangements

ME Leave & Volunteer Day

Free coffee

Additional leave purchase

Return To Work bonus

Award and recognition program

Job summary

Compare the Market (iSelect and CTM brands) is seeking a Lead Data Engineer to provide technical leadership for its Data & Analytics platforms. The role shapes the enterprise data tech stack, sets engineering standards, and delivers scalable, secure data solutions supporting reporting, analytics, AI, and business innovation.

As the technical SME for data engineering, you will mentor engineers, drive DataOps and MLOps, govern cloud-based data warehouses and lakehouses across AWS/Azure/GCP, and

Qualifications

• Bachelor degree in Computer Science, Analytics, IT or a relevant discipline.
• 10+ years' experience in Data Engineering/Analytics/BI environments, including leading enterprise-scale data initiatives.
• Experience designing, building, and governing cloud-based data platforms (AWS/Azure/GCP) including data warehouses, lakehouses.

Responsibilities

• Provide technical leadership and architectural oversight across the Data & Analytics function, ensuring alignment with enterprise architecture, security and scalability.
• Own and optimise the analytics ecosystem, including cloud data platforms, lakehouse environments, data integration, governance and AI readiness.
• Lead the design and delivery of scalable data products, advanced analytics, and GenAI-enabled solutions for self-service insights and AI capabilities.
• Drive engineering excellence through DataOps, SecOps, CI/CD, IaC, automated testing, observability and automation.
• Ensure platform reliability, security governance, and compliance with data quality, metadata, access controls, and privacy.

Skills

Data engineering

Cloud data platforms

Data governance

DataOps

MLOps

Leadership

Stakeholder management

Education

Bachelor's degree in Computer Science/Analytics/IT

Tools

Databricks

Snowflake

Azure

AWS

GCP

Synapse

Job description

Compare the Market (iSelect and CTM brands) is seeking a Lead Data Engineer to provide technical leadership for its Data & Analytics platforms. The role shapes the enterprise data tech stack, sets engineering standards, and delivers scalable, secure data solutions supporting reporting, analytics, AI, and business innovation.

As the technical SME for data engineering, you will mentor engineers, drive DataOps and MLOps, govern cloud-based data warehouses and lakehouses across AWS/Azure/GCP, and