GCP Data Engineer: Build Scalable Data Pipelines

Ncsaustralia

Brisbane

On-site

AUD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Paid parental leave
Discounted health insurance
Career development programs
Product/service discounts

Job summary

NCS Australia is seeking an experienced Data Engineer to design and scale our massive, reliable data infrastructure across the organization. You will build end-to-end data pipelines in GCP, optimize BigQuery data models, and collaborate with data scientists and engineers to enable data-driven decision making.

You will tackle petabyte-scale challenges, implement CI/CD for data workflows, and advocate data quality, security, and governance while leveraging tools like Dataflow, Pub/Sub, and

Qualifications

  • Experience with Google Cloud Platform (GCP) data services and BigQuery.
  • Strong background in building scalable data pipelines (ETL/ELT) for petabyte-scale workloads.
  • Familiarity with data governance, security, and data quality practices.
  • Experience with real-time streaming data processing (Pub/Sub, Dataflow Streaming).
  • Proficiency in containerization and orchestration (Docker, Kubernetes).

Responsibilities

  • Design, build, test, and maintain scalable data pipelines (ETL/ELT) using Dataflow, Composer, and BigQuery.
  • Architect and optimize data models in BigQuery for performance and cost efficiency.
  • Collaborate with Data Scientists, Analysts, and Software Engineers to ensure data quality and security.
  • Monitor, troubleshoot, and continuously improve production data systems and CI/CD for data pipelines.
  • Explore new data technologies and cloud services to enhance architecture and governance.

Skills

BigQuery
Dataflow
Pub/Sub
Cloud Composer
Data modeling

Tools

Docker
Kubernetes
Terraform
Python
Git
Bash

Job description

NCS Australia is seeking an experienced Data Engineer to design and scale our massive, reliable data infrastructure across the organization. You will build end-to-end data pipelines in GCP, optimize BigQuery data models, and collaborate with data scientists and engineers to enable data-driven decision making.

You will tackle petabyte-scale challenges, implement CI/CD for data workflows, and advocate data quality, security, and governance while leveraging tools like Dataflow, Pub/Sub, and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer: Scale BigQuery & Dataflow Pipelines
GCP Data Engineer: Scale BigQuery & Dataflow Pipelines

Ncs Australia • Australia

On-site
AUD 120,000 - 160,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

NCS • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: ETL, BigQuery & Cloud Pipelines
GCP Data Engineer: ETL, BigQuery & Cloud Pipelines

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
GCP Data Engineer — Build Scalable Data Pipelines
GCP Data Engineer — Build Scalable Data Pipelines

TaskVerse • Melbourne

On-site
AUD 120,000 - 180,000
GCP Data Engineer: ETL, BigQuery & Airflow Expert
GCP Data Engineer: ETL, BigQuery & Airflow Expert

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
Google Cloud Data Engineer — Real-Time Pipelines & Governance
Google Cloud Data Engineer — Real-Time Pipelines & Governance

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
Top locations