Brisbane Onsite Senior Data Platform Engineer

Clicks IT Recruitment; City of Brisbane; On-site; AUD 166,000 - 203,000; Full time

Job summary

Clicks IT Recruitment is seeking a Senior Software Engineer - Data Platform for a Brisbane-based team focusing on scalable telemetry ingestion platforms, streaming pipelines, and cloud-native modernization. You will work at the intersection of software engineering, data engineering and data science to process high-frequency machine data from assets.

You will use Java, Python/Scala, Spark, Flink, Kafka, and deploy with Docker/Kubernetes, collaborating with architects and data scientists to

Qualifications

• Strong backend or data-intensive software experience.
• Advanced Java development skills.
• Experience building large-scale data platforms and pipelines.
• Hands-on with Spark, Flink or similar distributed processing frameworks.
• Knowledge of data lake/lakehouse architectures.

Responsibilities

• Build scalable platforms for high-volume telemetry ingestion.
• Develop streaming and batch data pipelines.
• Modernise legacy applications into cloud-native platforms.
• Build and optimise workloads using Spark, Flink and related technologies.
• Design data lake/lakehouse solutions (Delta Lake).
• Partner with Data Scientists to operationalise ML models.

Skills

Java

Python

Scala

Distributed systems

Data platform design

Tools

Apache Spark

Apache Flink

Kafka

MQTT

Docker

Kubernetes

Delta Lake

Apache Iceberg

PostgreSQL

Redis

Trino

DuckDB

Dask

Daft

Job description

Clicks IT Recruitment is seeking a Senior Software Engineer - Data Platform for a Brisbane-based team focusing on scalable telemetry ingestion platforms, streaming pipelines, and cloud-native modernization. You will work at the intersection of software engineering, data engineering and data science to process high-frequency machine data from assets.

You will use Java, Python/Scala, Spark, Flink, Kafka, and deploy with Docker/Kubernetes, collaborating with architects and data scientists to