Data Engineer with GCP

XPT Software

Sydney

On-site

AUD 120,000 - 150,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

XPT Software in Sydney is seeking a data engineer to design, build, and maintain scalable data pipelines on Google Cloud. You will develop ETL/ELT processes, work with BigQuery, and implement data quality and governance practices.

You will collaborate with analysts and data scientists, optimize performance and costs, and ensure security and compliance across data platforms.

Qualifications

  • Must have strong experience with Google Cloud Platform (GCP).
  • Hands-on BigQuery experience required.
  • Proficient in Python and SQL programming.
  • Experience building ETL/ELT data pipelines.
  • Experience with Cloud Dataflow and/or Apache Beam.
  • Knowledge of Cloud Storage (GCS).
  • Experience with data modelling and data warehousing.
  • Experience with batch and real-time data processing.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using GCP services.
  • Build and optimise ETL/ELT workflows for batch and real-time data processing.
  • Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
  • Develop data processing solutions using Python, PySpark, and Apache Beam.
  • Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
  • Build and manage data lakes and data warehouses on Google Cloud.
  • Implement data quality checks, data validation, and monitoring.
  • Optimise pipeline performance, scalability, and cost efficiency.
  • Collaborate with data analysts, data scientists, architects, and business teams.
  • Ensure data security, governance, and compliance best practices.

Skills

GCP experience
BigQuery
Python
SQL
ETL/ELT pipelines
Dataflow/Beam
Cloud Storage
Data warehousing
Batch & real-time processing

Job description

Design, develop, and maintain scalable data pipelines using GCP services.

Build and optimise ETL/ELT workflows for batch and real-time data processing.

Work with Google BigQuery for data warehousing, SQL development, and query optimisation.

Develop data processing solutions using Python, PySpark, and Apache Beam.

Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.

Build and manage data lakes and data warehouses on Google Cloud.

Implement data quality checks, data validation, and monitoring.

Optimise pipeline performance, scalability, and cost efficiency.

Collaborate with data analysts, data scientists, architects, and business teams.

Ensure data security, governance, and compliance best practices.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using GCP services.
  • Build and optimise ETL/ELT workflows for batch and real-time data processing.
  • Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
  • Develop data processing solutions using Python, PySpark, and Apache Beam.
  • Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
  • Build and manage data lakes and data warehouses on Google Cloud.
  • Implement data quality checks, data validation, and monitoring.
  • Optimise pipeline performance, scalability, and cost efficiency.
  • Collaborate with data analysts, data scientists, architects, and business teams.
  • Ensure data security, governance, and compliance best practices.
Mandatory Technical Skills
  • Strong experience in Google Cloud Platform (GCP).
  • Hands-on experience with BigQuery.
  • Strong programming skills in Python and SQL.
  • Experience developing ETL/ELT data pipelines.
  • Experience with Cloud Dataflow and/or Apache Beam.
  • Knowledge of Cloud Storage (GCS).
  • Experience with data modelling and data warehousing.
  • Experience with batch and real-time data processing.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Data Engineer
Data Engineer

PRIMUS Global Services • Sydney

On-site
AUD 150,000 - 210,000
GCP Data Engineer
GCP Data Engineer

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
Sr GCP Data Engineer
Sr GCP Data Engineer

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer (Google)
GCP Data Engineer (Google)

Ncsaustralia • Brisbane

On-site
AUD 140,000 - 190,000
Paid parental leave
Discounted health insurance
Career development programs
+1
Senior Data Engineer
Senior Data Engineer

Saltus Group • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
GCP Solution Designer
GCP Solution Designer

ALOIS UK • Perth

On-site
AUD 120,000 - 180,000
Senior GCP Data Engineer
Senior GCP Data Engineer

Nityo Infotech • Sydney

On-site
AUD 90,000 - 140,000
Top locations