Cloud Data Engineering Lead - GCP & Kubernetes

XPT Software Australia; City of Melbourne; Presencial; AUD 120.000 - 160.000; Jornada completa

Descripción de la vacante

XPT Software Australia is seeking a data engineering professional to design, build, and optimize data pipelines in a GCP-centric environment. You will work on batch, streaming, and near-real-time processing, leveraging BigQuery, Kubernetes/GKE, and related GCP services.

The role requires strong SQL skills, ETL/ELT development experience, and a solid grasp of data quality and monitoring. Collaboration across teams will be essential in delivering scalable data solutions.

Formación

• Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near-real-time processing.
• Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
• Must have hands-on experience with GCP data services such as BigQuery, Kubernetes/GKE ,Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
• Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Responsabilidades

• Strong understanding of SDLC process.
• Should have Strong understanding and trouble shooting skills

Conocimientos

GCP BigQuery

Kubernetes/GKE

SQL

Herramientas

BigQuery

Kubernetes/GKE

Cloud Dataflow

Dataproc

Pub/Sub

Cloud Storage

Descripción del empleo

XPT Software Australia is seeking a data engineering professional to design, build, and optimize data pipelines in a GCP-centric environment. You will work on batch, streaming, and near-real-time processing, leveraging BigQuery, Kubernetes/GKE, and related GCP services.

The role requires strong SQL skills, ETL/ELT development experience, and a solid grasp of data quality and monitoring. Collaboration across teams will be essential in delivering scalable data solutions.