GCP Data Engineer: BigQuery & Real-Time Pipelines

XPT Software

Sydney

On-site

AUD 120,000 - 180,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

XPT Software in Sydney is looking for a data engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform, enabling reliable batch and real-time processing.

You will leverage BigQuery for data warehousing, write efficient Python and SQL, and implement Dataflow/Beam workflows. Collaboration with analysts and stakeholders is essential to ensure governance and security.

Qualifications

  • Proven experience delivering data pipelines on GCP.
  • Strong SQL and Python development skills.
  • Experience with BigQuery and data warehousing.

Responsibilities

  • Design, develop, and maintain scalable data pipelines on GCP.
  • Build ETL/ELT workflows for batch and real-time processing.
  • Work with BigQuery for warehousing, SQL development, and optimization.
  • Develop data processing solutions using Python, PySpark, and Apache Beam.
  • Implement data integration with Cloud Dataflow, Cloud Composer, Pub/Sub.
  • Build data lakes and warehouses on Google Cloud.
  • Implement data quality checks, validation, and monitoring.
  • Optimize pipeline performance and cost.
  • Collaborate with data analysts, scientists, architects, and business teams.
  • Ensure data security, governance, and compliance best practices.

Skills

GCP
BigQuery
Python
SQL
ETL/ELT
Dataflow
Beam
GCS
Data Warehousing

Job description

XPT Software in Sydney is looking for a data engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform, enabling reliable batch and real-time processing.

You will leverage BigQuery for data warehousing, write efficient Python and SQL, and implement Dataflow/Beam workflows. Collaboration with analysts and stakeholders is essential to ensure governance and security.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer: Real-Time Pipelines & BigQuery Expert
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
GCP Data Engineer: Scalable Pipelines & BigQuery
GCP Data Engineer: Scalable Pipelines & BigQuery

Ncsaustralia • Sydney

On-site
AUD 150,000 - 210,000
Paid parental leave
Well-being initiatives
Discounted health insurance
GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

NCS • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

Ncsaustralia • Brisbane

On-site
AUD 140,000 - 190,000
Paid parental leave
Discounted health insurance
Career development programs
+1
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Google Cloud Data Engineer — Real-Time Pipelines & Governance
Google Cloud Data Engineer — Real-Time Pipelines & Governance

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer - Real-Time ETL & Big Data on GCP
Data Engineer - Real-Time ETL & Big Data on GCP

Hydrogen Group • Sydney

On-site
AUD 166,000 - 203,000
Top locations