Data Engineer with GCP

XPT Software

Sydney

On-site

AUD 120,000 - 180,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

XPT Software in Sydney is looking for a data engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform, enabling reliable batch and real-time processing.

You will leverage BigQuery for data warehousing, write efficient Python and SQL, and implement Dataflow/Beam workflows. Collaboration with analysts and stakeholders is essential to ensure governance and security.

Qualifications

  • Proven experience delivering data pipelines on GCP.
  • Strong SQL and Python development skills.
  • Experience with BigQuery and data warehousing.

Responsibilities

  • Design, develop, and maintain scalable data pipelines on GCP.
  • Build ETL/ELT workflows for batch and real-time processing.
  • Work with BigQuery for warehousing, SQL development, and optimization.
  • Develop data processing solutions using Python, PySpark, and Apache Beam.
  • Implement data integration with Cloud Dataflow, Cloud Composer, Pub/Sub.
  • Build data lakes and warehouses on Google Cloud.
  • Implement data quality checks, validation, and monitoring.
  • Optimize pipeline performance and cost.
  • Collaborate with data analysts, scientists, architects, and business teams.
  • Ensure data security, governance, and compliance best practices.

Skills

GCP
BigQuery
Python
SQL
ETL/ELT
Dataflow
Beam
GCS
Data Warehousing

Job description

Key Responsibilities

Design, develop, and maintain scalable data pipelines using GCP services. Build and optimise ETL/ELT workflows for batch and real-time data processing. Work with Google BigQuery for data warehousing, SQL development, and query optimisation. Develop data processing solutions using Python, PySpark, and Apache Beam. Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub. Build and manage data lakes and data warehouses on Google Cloud. Implement data quality checks, data validation, and monitoring. Optimise pipeline performance, scalability, and cost efficiency. Collaborate with data analysts, data scientists, architects, and business teams. Ensure data security, governance, and compliance best practices.

Mandatory Technical Skills
  • Strong experience in Google Cloud Platform (GCP).
  • Hands-on experience with BigQuery.
  • Strong programming skills in Python and SQL.
  • Experience developing ETL/ELT data pipelines.
  • Experience with Cloud Dataflow and/or Apache Beam.
  • Knowledge of Cloud Storage (GCS).
  • Experience with data modelling and data warehousing.
  • Experience with batch and real-time data processing.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Data Engineer
Data Engineer

PRIMUS Global Services • Sydney

On-site
AUD 150,000 - 210,000
Sr GCP Data Engineer
Sr GCP Data Engineer

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Saltus Group • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer (Google)
GCP Data Engineer (Google)

Ncsaustralia • Sydney

On-site
AUD 150,000 - 210,000
Paid parental leave
Well-being initiatives
Discounted health insurance
GCP Data Engineer (Google)
GCP Data Engineer (Google)

Ncsaustralia • Brisbane

On-site
AUD 140,000 - 190,000
Paid parental leave
Discounted health insurance
Career development programs
+1
GCP Solution Designer
GCP Solution Designer

ALOIS UK • Perth

On-site
AUD 120,000 - 180,000
Senior GCP Data Engineer/GCP Data Engineer – Data Migration
Senior GCP Data Engineer/GCP Data Engineer – Data Migration

Renaissance InfoSystems • Melbourne

On-site
AUD 120,000 - 180,000
Top locations