Senior Data Engineer: Cloud Platform & AI Enablement

iSelect; City of Brisbane; On-site; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible work arrangements

ME leave and Volunteer Day leave

Free coffee on Mondays

9-day fortnight

Annual celebrations and events

Job summary

iSelect is seeking a Senior Data Engineer to design and evolve a cloud-based data platform that supports BI, analytics, ML, and Generative AI initiatives. You will lead data pipelines, governance, and platform optimisation while collaborating with business and tech stakeholders.

You will champion DataOps, automation, CI/CD, and secure data access, delivering scalable data products and AI-ready datasets for model development and deployment across AWS/Azure/GCP ecosystems.

Qualifications

• Bachelor’s degree in Computer Science, Analytics, IT or a relevant discipline.
• 7+ years in Data Engineering/Analytics/DBA/BI with enterprise-scale data solutions.
• 5+ years designing and supporting cloud data platforms and data products across AWS/Azure/GCP.
• Strong data architectures: Data Warehouse, Lakehouse, Data Mesh, Data Vault, metadata, lineage & data quality.

Responsibilities

• Design, develop, and support scalable cloud-based data warehouse, lakehouse, and AI-enabled data platform solutions for analytics and future ML/AI initiatives.
• Build and maintain batch, streaming, and near real-time data pipelines and data products with high quality, governed data.
• Develop data workflows using AI agents, orchestration, and modern AI platform capabilities to improve operations.
• Support AI initiatives by delivering AI-ready datasets, vector search, and secure scalable data solutions for model development and deployment.
• Implement DataOps, SecOps, CI/CD, IaC, observability, and data security controls across platforms.
• Ensure governance, security, privacy, and quality standards while improving platform capabilities and cost efficiency.

Skills

Data engineering

Python

SQL

Apache Spark

PySpark

DataOps

MLOps

ETL/ELT

CI/CD

Cloud data warehouses

Education

Bachelor's degree in CS/Analytics

Tools

Databricks

Snowflake

Redshift

Kinesis

Kafka

Fabric

Synapse

BigQuery

Job description

iSelect is seeking a Senior Data Engineer to design and evolve a cloud-based data platform that supports BI, analytics, ML, and Generative AI initiatives. You will lead data pipelines, governance, and platform optimisation while collaborating with business and tech stakeholders.

You will champion DataOps, automation, CI/CD, and secure data access, delivering scalable data products and AI-ready datasets for model development and deployment across AWS/Azure/GCP ecosystems.