Software Backend Engineer — Data Pipeline Remote (Australia) 3+ years

NXTGEN Industries Pty Ltd; Australia; Remote; AUD 110,000 - 170,000; Full time

Job summary

NXTGEN Industries Pty Ltd is seeking a Backend Engineer focused on data pipelines to design, build, and maintain systems that move high-volume inspection data from field devices through analysis, storage, and reporting. Reliability and latency are the primary constraints, not feature richness.

In this role you will design asynchronous, event-driven pipelines, create robust ingestion services, optimise storage for large binary payloads, and implement scalable queues.

Qualifications

• 3+ years of backend engineering with data movement and processing at scale.
• Proficiency in Python or Node.js for pipeline and worker development.
• Experience with message queues or streaming systems (RabbitMQ, SQS, Kafka).
• Solid understanding of cloud object storage patterns (S3, Azure Blob, GCS).
• Experience handling large binary file processing pipelines in production.
• Strong observability with structured logging, metrics and alerts.

Responsibilities

• Design and operate asynchronous, event-driven pipelines for inbound inspection data.
• Build robust ingestion services that handle intermittent connectivity and partial uploads.
• Optimise storage strategies for large binary payloads on cloud object storage.
• Implement processing queues and worker architectures that scale to burst loads.
• Maintain data quality and completeness checks at every pipeline stage.
• Design and document data contracts between field devices, pipelines, and consumers.

Skills

Python/Node.js

Data pipelines

Cloud storage

Message queues

Observability

Tools

RabbitMQ

Kafka

SQS

S3

GCS

Azure Blob

Job description

The Role

We are looking for a Backend Engineer focused on data pipelines to design, build, and maintain the systems that move high-volume inspection data from field devices through to analysis, storage, and reporting. Reliability and latency are the primary constraints — not feature richness.

What You Will Do

• Design and operate asynchronous, event-driven pipelines for inbound inspection data (imagery, point clouds, sensor telemetry)
• Build robust ingestion services that handle intermittent connectivity, partial uploads, and field device variability
• Optimise storage strategies for large binary payloads (images, video, point cloud files) on cloud object storage
• Implement processing queues and worker architectures that scale to handle burst inspection loads
• Maintain data quality and completeness checks at every pipeline stage
• Design and document data contracts between field devices, pipelines, and downstream platform consumers

What We Are Looking For

• 3+ years of backend engineering with a focus on data movement and processing at scale
• Strong proficiency in Python or Node.js for pipeline and worker service development
• Experience with message queue or streaming systems (RabbitMQ, SQS, Kafka, or similar)
• Solid understanding of cloud object storage patterns (S3, Azure Blob, or GCS)
• Experience handling large binary file processing pipelines in production
• Strong observability instincts: structured logging, metrics, alerting for pipeline health

Where You’ll Work

Our head office is in Melbourne and we have a second office in Sydney. We are open to flexible and remote working arrangements anywhere in Australia for the right person, so where you are based should not stop you from applying.

You are welcome to work from either office if you would prefer to, and we will get you out to site from time to time so you can see the systems your work supports running in the field.