GCP Data Engineering Lead – Pipelines & SQL

Xpt Software Australia Pty

Victoria

On-site

AUD 130,000 - 180,000

Full time

3 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Xpt Software Australia Pty is hiring a data engineer to build, optimize, and maintain data pipelines across batch, streaming, and near real-time processing. The role requires hands-on use of GCP data services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage, with strong SQL and ETL/ELT capabilities.

You will design reusable frameworks and ensure production-grade quality with solid monitoring.

Qualifications

Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near real time processing.
Must design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
Must have hands-on experience with GCP data services such as BigQuery, Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Responsibilities

Build and maintain data pipelines for batch, streaming, and near real-time processing.
Design reusable data engineering frameworks, accelerators, and templates.
Leverage GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
Ensure production-grade pipelines with robust error handling, logging, monitoring, and performance optimization.