Data Engineer with GCP

XPT Software Australia Pty Ltd; Sydney; On-site; AUD 90,000 - 120,000; Full time

Job summary

XPT Software Australia Pty Ltd in Sydney is seeking a Data Engineer with GCP expertise to design and implement scalable data pipelines. You will work on BigQuery data warehousing, SQL development, and real-time processing using Python and Apache Beam.

The role emphasizes data quality, security, and governance while collaborating with analysts and business teams. The contract position offers exposure to large-scale cloud data architectures, cost-efficient pipeline design, and close interaction

Qualifications

• Experience designing and implementing scalable data pipelines on Google Cloud Platform (GCP).
• Proficient in BigQuery data warehousing, SQL development, and query optimization.
• Strong programming skills in Python and SQL for data processing tasks.
• Experience with batch and real-time data processing architectures and ETL/ELT pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services.
• Build and optimise ETL/ELT workflows for batch and real-time data processing.
• Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
• Develop data processing solutions using Python, PySpark, and Apache Beam.
• Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
• Build and manage data lakes and data warehouses on Google Cloud.
• Implement data quality checks, data validation, and monitoring.
• Optimise pipeline performance, scalability, and cost efficiency.
• Collaborate with data analysts, data scientists, architects, and business teams.
• Ensure data security, governance, and compliance best practices.

Skills

Google Cloud Platform

BigQuery

Python

SQL

Cloud Dataflow

Apache Beam

Cloud Storage

Tools

Cloud Dataflow

Apache Beam

Cloud Composer

Pub/Sub

GCS

Job description

XPT Software Australia Pty Ltd | Contract

Data Engineer with GCP

Sydney, Australia | Posted on 11/12/2026

• XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
  
• XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
  
• We have 120+technocrats in Australia working at our clientlocations.
  
• XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
  
• We have served100+ clients globally, fulfilling their onsite-offshoreneeds.
  

Job Description

Key Responsibilities

Design, develop, and maintain scalable data pipelines using GCP services.

Build and optimise ETL/ELT workflows for batch and real-time data processing.

Work with Google BigQuery for data warehousing, SQL development, and query optimisation.

Develop data processing solutions using Python, PySpark, and Apache Beam.

Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.

Build and manage data lakes and data warehouses on Google Cloud.

Implement data quality checks, data validation, and monitoring.

Optimise pipeline performance, scalability, and cost efficiency.

Collaborate with data analysts, data scientists, architects, and business teams.

Ensure data security, governance, and compliance best practices.

Mandatory Technical Skills

Strong experience in Google Cloud Platform (GCP).

Hands-on experience with BigQuery.

Strong programming skills in Python and SQL.

Experience with Cloud Dataflow and/or Apache Beam.

Knowledge of Cloud Storage (GCS).

Experience with data modelling and data warehousing.

Experience with batch and real-time data processing.