Data Engineer

uniquehire; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

UniqueHire is seeking a skilled GCP Data Engineer to design, build and optimize scalable data pipelines on Google Cloud Platform (GCP). The role focuses on modern data architecture and big data processing using GCP services such as BigQuery, Cloud Run, Cloud Storage, Pub/Sub and Cloud Composer.

You will work with SQL and Python for data transformation, implement dbt models, and design resilient batch and streaming pipelines with observability.

Qualifications

• Strong SQL, data analysis and analytical skills.
• Proficiency in Python and SQL for scripting, automation, and data transformation logic.
• Hands-on experience designing and architecting solutions on Google Cloud Platform (GCP).
• Experience with dbt for modular SQL transformation.
• Proficiency in data warehousing concepts such as partitioning, clustering, schema design, data modelling, and query optimisation.
• Experience designing batch and streaming data pipelines with resilience, idempotency, and observability.
• Familiarity with GCP DevOps tooling including Cloud Build, Artifact Registry, and Cloud Logging.
• Exposure to data pipeline migrations, including replatforming ETL/ELT workloads onto GCP native services.

Responsibilities

• Hands on experience designing and architecting solutions on Google Cloud Platform (GCP), including BigQuery, Cloud Run, Cloud Storage, Pub/Sub, and Cloud Composer
• Strong SQL, data analysis and analytical skills
• Proficiency in Python and SQL for scripting, automation, and data transformation logic
• Experience with dbt (data build tool) for modular SQL transformation
• Proficiency in data warehousing concepts – partitioning, clustering, schema design, data modelling, and query optimisation
• Experience designing batch and streaming data pipelines with resilience, idempotency, and observability built in
• Proficiency in GCP DevOps tooling including Cloud Build, Artifact Registry, and Cloud Logging
• Exposure to data pipeline migrations, including replatforming ETL/ELT workloads onto GCP native services
• Familiarity with cutover planning, rollback strategies, and migration risk management in production environments
• Experience working within Change Advisory Board (CAB) and RFC-driven change management processes

Skills

SQL

Python

Data pipelines

GCP

BigQuery

dbt

Data warehousing

ETL/ELT

Change management

DevOps

Tools

Cloud Run

Cloud Storage

Pub/Sub

Cloud Composer

Cloud Build

Artifact Registry

Cloud Logging

IAM/Secret Manager

Job description

We are looking for a skilled GCP Data Engineer to design, build, and optimize scalable data pipelines and data platforms on Google Cloud Platform (GCP). The ideal candidate will have strong experience in big data processing, cloud data services, and modern data architecture.

Key Responsibilities

• Hands on experience designing and architecting solutions on Google Cloud Platform (GCP), including BigQuery, Cloud Run, Cloud Storage, Pub/Sub, and Cloud Composer
• Strong SQL, data analysis and analytical Skills
• Proficiency in Python and SQL for scripting, automation, and data transformation logic
• Experience with dbt (data build tool) for modular SQL transformation
• Proficiency in data warehousing concepts ‿ partitioning, clustering, schema design, data modelling, and query optimisation
• Experience designing batch and streaming data pipelines with resilience, idempotency, and observability built in
• Proficiency in GCP DevOps tooling including Cloud Build, Artifact Registry, and Cloud Logging
• Exposure to data pipeline migrations, including replatforming ETL/ELT workloads onto GCP native services
• Familiarity with cutover planning, rollback strategies, and migration risk management in production environments
• Experience working within Change Advisory Board (CAB) and RFC driven change management processes

Required Skills:

• Good understanding of GCP networking concepts including VPC, Private Service Connect, Firewall Rules, and Cloud Interconnect
• Experience with IAM, Service Accounts, Secret Manager, and least privilege access controls in enterprise GCP environments
• Demonstrated experience in end to end platform migrations/ remediations ‿ including legacy to cloud and on premise to GCP migrations