Senior Software Engineer - Data Platform (Mining Operational Technology)

Task Recruitment; City of Brisbane; On-site; AUD 150,000 - 185,000; Full time

Job summary

Task Recruitment is hiring two Senior Software Engineers in Brisbane to build scalable data platforms handling high‑frequency telemetry from mining equipment. You’ll join a specialist team within a large global program spanning Australia, the US, Canada and India.

You will design and evolve backend systems using Java/Spring Boot, Python/Scala, and modern data tooling such as Spark, Delta Lake, and Kubernetes.

Qualifications

• Strong backend software engineering experience in Java/Spring Boot with ability to work across Python/Scala
• Experience designing microservices and distributed applications
• Experience with large data volumes and both streaming and batch processing
• Familiarity with data lake/lakehouse architectures (Delta Lake) and messaging/streaming tech (MQTT, Kafka)
• Experience with Docker and Kubernetes
• Collaboration across geographically distributed teams

Responsibilities

• Design scalable components and microservices for ingesting, processing and persisting high‑frequency telemetry data
• Build solutions for real‑time streaming and large‑scale batch processing
• Collaborate with data scientists to host and optimise Python/Scala/Java workloads
• Modernise Java/Spring Boot monolith toward a microservices architecture
• Containerise and deploy using Docker and Kubernetes
• Integrate with S3‑compatible object storage
• Contribute to architectural decisions around event sourcing, CQRS and hybrid cloud deployments
• Evaluate emerging tech to improve performance and scalability
• Work with teams across Australia, the US, Canada and India

Skills

Backend engineering

Java/Spring Boot

Python

Scala

Spark

Kubernetes

Delta Lake

Redis/Valkey

MQTT

PostgreSQL

Docker

Tools

Apache Spark

Delta Lake

Docker

Kubernetes

Redis/Valkey

MQTT

PostgreSQL

Kafka

Job description

Build scalable data platforms processing large volumes of streaming & batch data for a leading global mining OEM and technology provider. Brisbane-based, in-office roles.

• 2 newly created Senior Software Engineer positions
• Join an established specialist technology team of 10 people
• Work within a large global program with teams across Australia, the US, Canada & India
• Build with Java/Spring Boot, microservices, Python, Scala, Spark, Kubernetes, Delta Lake & more
• Work in a modern software engineering environment making extensive use of AI in development and testing

Build the data platforms behind the future of mining technology.

We have two newly created Senior Software Engineer positions with a leading global mining OEM and technology provider, developing sophisticated technology used across mining operations around the world.

You'll join an established 10-person specialist technology team working within a large global technology program with distributed teams across Australia, the US, Canada and India.

We're looking for experienced Senior Software Engineers / Senior Developers with strong backend software engineering skills to help build and evolve a scalable data platform that ingests large quantities of high-frequency telemetry from mobile mining equipment.

A major focus of the roles will be designing solutions capable of processing data through both real‑time streaming and large‑scale batch workloads, while supporting data science, machine learning and predictive modelling.

You'll also help transform an existing Java/Spring Boot monolith into a modern microservices‑based, containerised, scalable and cloud‑ready architecture.

What you'll be working on

This is a hands‑on software engineering role sitting at the intersection of backend engineering, microservices, big data, distributed systems and data platforms.

You'll help design and build technology capable of reliably ingesting, processing and storing large quantities of high‑frequency machine telemetry, using both streaming and batch data processing.

Working alongside software engineers and data scientists, and collaborating with globally distributed teams, you'll help create an environment capable of supporting large‑scale data workloads, lakehouse persistence and low‑latency predictive model hosting.

The broader software engineering group is also making extensive use of AI across software development and testing, providing the opportunity to work with contemporary AI‑assisted engineering practices as part of the development lifecycle.

Your responsibilities will include:

• Designing scalable components and microservices for ingesting, processing and persisting large quantities of high‑frequency telemetry data
• Building solutions supporting both real‑time streaming and large‑scale batch processing
• Collaborating with data scientists to host, orchestrate and optimise workloads across Python, Scala and Java
• Building solutions using technologies including Apache Spark, Delta Lake, Redis/Valkey, MQTT and PostgreSQL
• Helping modernise the existing Java/Spring Boot monolith towards a microservices‑based architecture
• Containerising and deploying applications using Docker and Kubernetes
• Integrating with S3‑compatible object storage
• Contributing to architectural decisions around event sourcing, CQRS and hybrid cloud deployments
• Evaluating emerging technologies including Flink, Trino, Kafka, DuckDB, Dask and Daft to improve performance and scalability
• Collaborating with engineering and technology teams across Australia, the US, Canada and India

What we're looking for

You'll bring strong backend software engineering experience and be comfortable solving complex problems involving large data quantities, streaming and batch processing, microservices, distributed systems and modern application architectures.

Ideally, you'll have:

• Strong backend software development experience, ideally with Java/Spring Boot, together with experience or the ability to work across Python and/or Scala
• Experience designing and developing microservices and distributed applications
• Demonstrated experience working with large quantities and high volumes of data
• Strong experience with streaming and batch data processing, ideally using Apache Spark or similar technologies
• Experience with Docker and Kubernetes
• Familiarity with data lake/lakehouse architectures, particularly Delta Lake
• Knowledge of messaging and streaming technologies such as MQTT and Kafka
• Experience with caching technologies such as Redis/Valkey
• The ability to work comfortably across multiple programming languages
• Experience collaborating effectively within large, geographically distributed software development environments

Previous Data Engineering experience will be highly regarded, as will experience with machine learning algorithms and statistical modelling.

Experience within the mining industry would also be beneficial but is not essential.

Why consider this opportunity? This isn't your typical enterprise data environment.

These are two newly created positions, giving you the opportunity to join an established specialist team while also working as part of a much larger global technology program.

You'll be working with large quantities of data generated by real‑world mobile mining equipment, tackling challenging engineering problems around streaming, batch processing, microservices, scalability, performance and reliability.

You'll have the opportunity to influence architecture, explore emerging technologies and contribute to the evolution of a sophisticated data platform supporting advanced mining technology.

Location & Work Requirements

These are in‑office roles based in Brisbane and are suited to people who enjoy working closely and collaboratively with their team.

Candidates currently living within the Greater Brisbane area will be preferred.

Due to the requirements of the positions, applications can only be considered from candidates who are:

• Australian Permanent Residents
• New Zealand Citizens

Unfortunately, candidates requiring visa sponsorship cannot be considered for these opportunities.