Data Platform Lead: GCP, BigQuery & Kubernetes

XPT Software Australia Pty Ltd; City of Melbourne; On-site; AUD 120,000 - 150,000; Part time

Job summary

XPT Software Australia Pty Ltd is seeking a Technology Lead in Melbourne to drive data engineering initiatives across batch, streaming and near real-time processing.

The role requires hands-on expertise with GCP data services such as BigQuery, Pub/Sub, Dataflow and Dataproc, plus strong SQL and Kubernetes/GKE skills, and a solid SDLC understanding. You will design reusable data engineering frameworks and production-grade pipelines.

Qualifications

• Must have strong experience in building, enhancing, and maintaining data pipeline frameworks.
• Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
• Must have hands-on experience with GCP data services such as BigQuery, Kubernetes/GKE, Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
• Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Responsibilities

• Design and implement data pipelines that handle batch, streaming, and near real-time processing.
• Develop reusable data engineering frameworks and templates.
• Work with GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Ensure production-grade pipelines with logging, monitoring, and performance optimization.
• Collaborate with teams to align SDLC processes.

Skills

GCP BigQuery

Kubernetes/GKE

SQL

Tools

BigQuery

Kubernetes/GKE

Cloud Dataflow

Dataproc

Pub/Sub

Cloud Storage

Job description

XPT Software Australia Pty Ltd is seeking a Technology Lead in Melbourne to drive data engineering initiatives across batch, streaming and near real-time processing.

The role requires hands-on expertise with GCP data services such as BigQuery, Pub/Sub, Dataflow and Dataproc, plus strong SQL and Kubernetes/GKE skills, and a solid SDLC understanding. You will design reusable data engineering frameworks and production-grade pipelines.