GCP Data Engineer

Avance Consulting; City of Melbourne; On-site; AUD 120,000 - 180,000; Full time

Job summary

Avance Consulting in Melbourne, Australia, is seeking an experienced GCP Data Engineer to design, develop and maintain scalable cloud data solutions on Google Cloud Platform.

Design pipelines, optimize BigQuery, build dbt models, and implement CI/CD, with collaboration across analytics and engineering teams; experience with GKE and data governance preferred.

The role offers exposure to leading cloud technologies and the chance to drive data-driven decisions for clients in the region.

Qualifications

• Strong hands-on experience with Google Cloud Platform (GCP).
• Excellent experience with Google BigQuery.
• Strong experience with dbt (Data Build Tool).
• Hands-on experience with Google Kubernetes Engine (GKE).
• Strong SQL development and query optimization skills.
• Experience with Python or another programming language.
• Understanding of cloud data warehouse and data lake concepts.
• Experience with Git and CI/CD practices.

Responsibilities

• Design and develop scalable data pipelines and data platforms using Google Cloud Platform (GCP).
• Develop and optimize complex BigQuery datasets, tables, views, and SQL queries.
• Build and maintain data transformation workflows using dbt.
• Develop reusable dbt models, macros, tests, and documentation.
• Implement data quality, validation, and monitoring frameworks.
• Deploy and manage data applications and services using Google Kubernetes Engine (GKE).
• Work with cloud-native services to build scalable and highly available data solutions.
• Optimize BigQuery performance and control query/storage costs.
• Develop and maintain ETL/ELT pipelines for batch and near-real-time data processing.
• Integrate data from multiple sources into GCP-based data platforms.
• Implement CI/CD pipelines for data engineering and cloud deployments.
• Work closely with Data Architects, Analysts, Developers, and business stakeholders.
• Follow security, governance, data quality, and compliance standards.

Skills

GCP

BigQuery

SQL

Python

CI/CD

Data modeling

Data governance

Cloud security

Kubernetes

Looker

Tools

dbt (Data Build Tool)

Google Kubernetes Engine

Terraform

Docker

Apache Airflow

Pub/Sub

Looker

Job description

We are looking for an experienced GCP Data Engineer with strong hands‑on experience in Google BigQuery, dbt, and Google Kubernetes Engine (GKE). The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud data solutions on Google Cloud Platform.

Key Responsibilities

• Design and develop scalable data pipelines and data platforms using Google Cloud Platform (GCP).
• Develop and optimize complex BigQuery datasets, tables, views, and SQL queries.
• Build and maintain data transformation workflows using dbt.
• Develop reusable dbt models, macros, tests, and documentation.
• Implement data quality, validation, and monitoring frameworks.
• Deploy and manage data applications and services using Google Kubernetes Engine (GKE).
• Work with cloud‑native services to build scalable and highly available data solutions.
• Optimize BigQuery performance and control query/storage costs.
• Develop and maintain ETL/ELT pipelines for batch and near‑real‑time data processing.
• Integrate data from multiple sources into GCP‑based data platforms.
• Implement CI/CD pipelines for data engineering and cloud deployments.
• Work closely with Data Architects, Analysts, Developers, and business stakeholders.
• Follow security, governance, data quality, and compliance standards.

Mandatory Skills

• Strong hands‑on experience with Google Cloud Platform (GCP).
• Excellent experience with Google BigQuery.
• Strong experience with dbt (Data Build Tool).
• Hands‑on experience with Google Kubernetes Engine (GKE).
• Strong SQL development and query optimization skills.
• Experience with Python or another programming language.
• Understanding of cloud data warehouse and data lake concepts.
• Experience with Git and CI/CD practices.

Good to Have

• Cloud Composer / Apache Airflow
• Pub/Sub
• Terraform
• Docker
• Looker
• GCP security and IAM
• Data governance and data quality frameworks