Real-Time Finance Data Engineer: ETL, Kafka & ClickHouse

Westpac Group; Sydney; On-site; AUD 133,000 - 147,000; Full time

Benefits offered by this job

Competitive Salary

Career Growth

Cross-region exposure

Health Benefits

Flexible work

Job summary

TMGM is seeking a Senior Data Engineer to design and enhance our high-throughput data ecosystem in Sydney, working with real-time analytics and financial datasets. You will implement scalable ETL/ELT pipelines, and real-time streams using Kafka, RabbitMQ, and Airflow, while enabling efficient data access via ClickHouse.

This hands‑on role focuses on engineering excellence within a regulatory financial context.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proven experience in data engineering with ETL/ELT in cloud environments.
• Experience in Finance or Trading tech with real‑time data processing.
• Strong Python and SQL skills for robust, scalable data pipelines.

Responsibilities

• Design, develop, and improve scalable, fault‑tolerant ETL/ELT pipelines.
• Build and maintain real‑time messaging and stream processing with Kafka and RabbitMQ for sub‑second data availability.
• Work with ClickHouse to optimise schema designs, indexing, and query performance for large datasets.
• Deploy and maintain data services in cloud environments with security controls and governance.

Skills

Python

ETL/ELT pipelines

SQL

Education

Bachelor’s or Master’s in CS/Engineering or related field

Tools

Kafka

RabbitMQ

Airflow

ClickHouse

Cloud environments

Job description

TMGM is seeking a Senior Data Engineer to design and enhance our high-throughput data ecosystem in Sydney, working with real-time analytics and financial datasets. You will implement scalable ETL/ELT pipelines, and real-time streams using Kafka, RabbitMQ, and Airflow, while enabling efficient data access via ClickHouse.

This hands‑on role focuses on engineering excellence within a regulatory financial context.