Senior Software Engineer - Data Platform

Clicks IT Recruitment; City of Brisbane; On-site; AUD 166,000 - 203,000; Full time

Job summary

Clicks IT Recruitment is seeking a Senior Software Engineer - Data Platform for a Brisbane-based team focusing on scalable telemetry ingestion platforms, streaming pipelines, and cloud-native modernization. You will work at the intersection of software engineering, data engineering and data science to process high-frequency machine data from assets.

You will use Java, Python/Scala, Spark, Flink, Kafka, and deploy with Docker/Kubernetes, collaborating with architects and data scientists to

Qualifications

• Strong backend or data-intensive software experience.
• Advanced Java development skills.
• Experience building large-scale data platforms and pipelines.
• Hands-on with Spark, Flink or similar distributed processing frameworks.
• Knowledge of data lake/lakehouse architectures.

Responsibilities

• Build scalable platforms for high-volume telemetry ingestion.
• Develop streaming and batch data pipelines.
• Modernise legacy applications into cloud-native platforms.
• Build and optimise workloads using Spark, Flink and related technologies.
• Design data lake/lakehouse solutions (Delta Lake).
• Partner with Data Scientists to operationalise ML models.

Skills

Java

Python

Scala

Distributed systems

Data platform design

Tools

Apache Spark

Apache Flink

Kafka

MQTT

Docker

Kubernetes

Delta Lake

Apache Iceberg

PostgreSQL

Redis

Trino

DuckDB

Dask

Daft

Job description

Senior Software Engineer - Data Platform

Senior Software Engineer - Data Platform

12 month contract

Full-time onsite work required – Brisbane CBD / Remote applicants will not be considered

Up to $1000 per day (including Superannuation)

We're partnering with a global leader in mining technology to recruit an experienced Senior Software Engineer - Data Platform.

This role sits within a specialist team responsible for the platform that powers large-scale machine telemetry processing across mining operations. Working at the intersection of software engineering, data engineering and data science, you'll help modernise a critical platform that ingests and processes high-frequency machine data from hundreds to thousands of assets in the field.

You’ll join a collaborative Brisbane-based team supported by experienced architects, domain experts and data scientists, contributing to the evolution of a cloud-ready, highly scalable platform that enables advanced analytics, predictive modelling and operational optimisation across mining fleets.

What you'll be doing

• Build scalable platforms for high-volume telemetry ingestion
• Develop streaming and batch data pipelines
• Modernise legacy applications into cloud-native platforms
• Build and optimise workloads using Apache Spark, Apache Flink and related technologies
• Design data lake and lakehouse solutions using Delta Lake and similar platforms
• Partner with Data Scientists to operationalise Machine Learning models
• Develop services across Java, Python and Scala
• Deploy containerised applications using Docker and Kubernetes
• Integrate with Kafka, MQTT and event-driven platforms
• Improve the performance, scalability and reliability of data workflows
• Contribute to distributed systems and platform architecture decisions
• Support low-latency processing for real-time analytics and insights
• Assess emerging technologies to enhance platform capability
• Collaborate with architects and SMEs on complex engineering challenges
• Own solutions from design through to production support

What you need to bring

• Strong software engineering experience in backend or data-intensive environments
• Advanced development skills in Java
• Commercial experience with Python and/or Scala
• Experience building large-scale data platforms and pipelines
• Hands-on expertise with Apache Spark, Apache Flink or similar distributed processing frameworks
• Strong understanding of streaming and batch processing architectures
• Experience with Kafka, MQTT or comparable messaging technologies
• Knowledge of modern data lake and lakehouse architectures
• Experience with Delta Lake, Apache Iceberg or equivalent technologies
• Strong experience with Docker and Kubernetes
• Experience designing scalable, distributed systems
• Understanding of cloud-native and container-based architectures
• Experience with PostgreSQL or other enterprise databases
• Proven ability to work effectively within cross-functional teams
• Strong problem-solving, troubleshooting and solution design skills

Bonus points for

• Mining, resources or industrial IoT experience
• Exposure to machine learning operationalisation or MLOps environments
• Experience with event sourcing and CQRS patterns
• Familiarity with Redis, Valkey or distributed caching technologies
• Experience with Trino, DuckDB, Dask, Daft or related data platform technologies
• Prior Data Engineering experience supporting Data Science teams

Important to know

• Full working rights required
• This role will require the successful candidate to work on site in Brisbane full-time 5 days per week.
• Remote applicants will not be considered.

If you're a hands-on engineer who enjoys building scalable data platforms, working closely with Data Scientists and solving complex streaming data challenges at scale, we'd love to hear from you.

Salary and benefits

Up to $1000 per day (including Superannuation)

$950 per annum

Diversity statement

At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply.

We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with a disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 *** or email ***********.

Job Summary

Location: Queensland, Brisbane

Job Type: Contract

Specialisation: Software Engineer

Reference ID: BH-77978