GCP Data Engineer: Scalable Pipelines & BigQuery

Ncsaustralia

Sydney

On-site

AUD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Paid parental leave
Well-being initiatives
Discounted health insurance

Job summary

NCS Australia is seeking a Data Engineer to build and scale our data infrastructure, handling petabyte-scale workloads with GCP technologies such as BigQuery, Dataflow, Pub/Sub, and Cloud Composer. You will transform raw data into actionable insights and work with data scientists, analysts, and engineers to ensure data quality and security.

You will design, implement, and manage end-to-end data processing systems with a focus on robustness, throughput, and cost efficiency, while championing data

Qualifications

  • Experience designing and building scalable data pipelines on GCP (BigQuery, Dataflow).
  • Proficient in Python and Bash for data processing tasks.
  • Strong understanding of DataOps, CI/CD for data platforms.
  • Ability to translate business needs into robust data architectures.
  • Familiarity with security and governance in cloud data environments.

Responsibilities

  • Design and build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Airflow.
  • Architect data models in BigQuery for performance and cost efficiency.
  • Collaborate with Data Scientists, Analysts, and Engineers to meet data needs.
  • Monitor and improve production data systems with CI/CD pipelines.
  • Explore new data technologies and cloud services to enhance architecture.

Skills

Python
Bash
CI/CD
Data modeling
Data governance
Cloud architecture
Team collaboration

Tools

BigQuery
Dataflow
Cloud Composer
Pub/Sub
Docker
Kubernetes
Terraform
Git

Job description

NCS Australia is seeking a Data Engineer to build and scale our data infrastructure, handling petabyte-scale workloads with GCP technologies such as BigQuery, Dataflow, Pub/Sub, and Cloud Composer. You will transform raw data into actionable insights and work with data scientists, analysts, and engineers to ensure data quality and security.

You will design, implement, and manage end-to-end data processing systems with a focus on robustness, throughput, and cost efficiency, while championing data

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

Ncsaustralia • Brisbane

On-site
AUD 140,000 - 190,000
Paid parental leave
Discounted health insurance
Career development programs
+1
GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer: BigQuery & Real-Time Pipelines
GCP Data Engineer: BigQuery & Real-Time Pipelines

XPT Software • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

NCS • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
GCP Data Engineer: ETL, BigQuery & Airflow Expert
GCP Data Engineer: ETL, BigQuery & Airflow Expert

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
Google Cloud Data Engineer — Real-Time Pipelines & Governance
Google Cloud Data Engineer — Real-Time Pipelines & Governance

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer (Google)
GCP Data Engineer (Google)

Ncsaustralia • Sydney

On-site
AUD 150,000 - 210,000
Paid parental leave
Well-being initiatives
Discounted health insurance
Top locations