Backend Data Pipeline Engineer — Remote Australia

NXTGEN Industries Pty Ltd; Australia; Remote; AUD 110,000 - 170,000; Full time

Job summary

NXTGEN Industries Pty Ltd is seeking a Backend Engineer focused on data pipelines to design, build, and maintain systems that move high-volume inspection data from field devices through analysis, storage, and reporting. Reliability and latency are the primary constraints, not feature richness.

In this role you will design asynchronous, event-driven pipelines, create robust ingestion services, optimise storage for large binary payloads, and implement scalable queues.

Qualifications

• 3+ years of backend engineering with data movement and processing at scale.
• Proficiency in Python or Node.js for pipeline and worker development.
• Experience with message queues or streaming systems (RabbitMQ, SQS, Kafka).
• Solid understanding of cloud object storage patterns (S3, Azure Blob, GCS).
• Experience handling large binary file processing pipelines in production.
• Strong observability with structured logging, metrics and alerts.

Responsibilities

• Design and operate asynchronous, event-driven pipelines for inbound inspection data.
• Build robust ingestion services that handle intermittent connectivity and partial uploads.
• Optimise storage strategies for large binary payloads on cloud object storage.
• Implement processing queues and worker architectures that scale to burst loads.
• Maintain data quality and completeness checks at every pipeline stage.
• Design and document data contracts between field devices, pipelines, and consumers.

Skills

Python/Node.js

Data pipelines

Cloud storage

Message queues

Observability

Tools

RabbitMQ

Kafka

SQS

S3

GCS

Azure Blob

Job description

NXTGEN Industries Pty Ltd is seeking a Backend Engineer focused on data pipelines to design, build, and maintain systems that move high-volume inspection data from field devices through analysis, storage, and reporting. Reliability and latency are the primary constraints, not feature richness.

In this role you will design asynchronous, event-driven pipelines, create robust ingestion services, optimise storage for large binary payloads, and implement scalable queues.