GCP Data Engineer (Google)

Ncsaustralia

Sydney

On-site

AUD 150,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Paid parental leave
Well-being initiatives
Discounted health insurance

Job summary

NCS Australia is seeking a Data Engineer to build and scale our data infrastructure, handling petabyte-scale workloads with GCP technologies such as BigQuery, Dataflow, Pub/Sub, and Cloud Composer. You will transform raw data into actionable insights and work with data scientists, analysts, and engineers to ensure data quality and security.

You will design, implement, and manage end-to-end data processing systems with a focus on robustness, throughput, and cost efficiency, while championing data

Qualifications

  • Experience designing and building scalable data pipelines on GCP (BigQuery, Dataflow).
  • Proficient in Python and Bash for data processing tasks.
  • Strong understanding of DataOps, CI/CD for data platforms.
  • Ability to translate business needs into robust data architectures.
  • Familiarity with security and governance in cloud data environments.

Responsibilities

  • Design and build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Airflow.
  • Architect data models in BigQuery for performance and cost efficiency.
  • Collaborate with Data Scientists, Analysts, and Engineers to meet data needs.
  • Monitor and improve production data systems with CI/CD pipelines.
  • Explore new data technologies and cloud services to enhance architecture.

Skills

Python
Bash
CI/CD
Data modeling
Data governance
Cloud architecture
Team collaboration

Tools

BigQuery
Dataflow
Cloud Composer
Pub/Sub
Docker
Kubernetes
Terraform
Git

Job description

This role is responsible for building and scaling the massive, reliable data infrastructure that powers critical decisions, product features, and advanced analytics across our organization-impacting billions of users daily. As a Data Engineer, you will be a core architect and builder of our next-generation data pipelines, transforming raw, high-volume data into structured, actionable insights. You will design, construct, implement, and rigorously manage end-to-end data processing systems, focusing on robustness, efficiency, security, and high throughput. Your challenge will be to translate complex, ambiguous business requirements from product managers and data scientists into scalable, fault-tolerant solutions using cutting-edge Google Cloud Platform (GCP) technologies. This includes deep involvement with services like BigQuery, Dataflow, Cloud Composer, and Pub/Sub. Your contributions will be instrumental in enabling data-driven optimization across areas such as product development, machine learning model training, and operational efficiency, making you a vital partner in Google's ongoing innovation. We're looking for an engineer ready to tackle petabyte-scale data challenges and champion data quality across the enterprise.

Responsibilities
  • Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
  • Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
  • Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
  • Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
  • Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.
Responsibilities
  • Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
  • Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
  • Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
  • Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
  • Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.

Strong background and experience in Google (GCP) along with a background as a Data Engineer.

Experience with real-time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Experience with version control systems (e.g., Git).

Deep understanding of DataOps principles and automated testing for data quality.

GCP Professional Data Engineer Certification is a plus.

Additional information
  • Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
  • Previous hands on Google Cloud experience
  • Previous experience of working on Federal Government projects
  • Previous experience building infrastructure as code with Terraform at an advanced level
  • Ability to script in at least one of the following languages: Python, Bash
  • Applied knowledge of CI/CD concepts and deployment of platform solutions
  • Solutions experience leveraging GCP-based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
  • Be well-versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
  • Experience designing secure and scalable network architectures on Google Cloud
  • Security-focused with a deep understanding of cloud security principles, threats, and mitigation techniques
  • Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications
Why join us:

NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time. Our benefits include paid parental leave, initiatives focused on your well-being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint, industry and partne

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Engineer (Google)
GCP Data Engineer (Google)

Ncsaustralia • Brisbane

On-site
AUD 140,000 - 190,000
Paid parental leave
Discounted health insurance
Career development programs
+1
GCP Data Engineer (Google)
GCP Data Engineer (Google)

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer - Contract or Perm
GCP Data Engineer - Contract or Perm

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
Gcp Data Engineer - Contract Or Perm
Gcp Data Engineer - Contract Or Perm

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
GCP Data Engineer - Contract or Perm
GCP Data Engineer - Contract or Perm

NCS • Sydney

On-site
AUD 120,000 - 180,000
Senior GCP Data Engineer/GCP Data Engineer – Data Migration
Senior GCP Data Engineer/GCP Data Engineer – Data Migration

Renaissance InfoSystems • Melbourne

On-site
AUD 120,000 - 180,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
Data Engineer with GCP
Data Engineer with GCP

XPT Software • Sydney

On-site
AUD 120,000 - 180,000
Google Cloud Architect / Lead Platform Engineer
Google Cloud Architect / Lead Platform Engineer

Ncsaustralia • Sydney

On-site
AUD 180,000 - 260,000
Top locations