GCP Data Engineer (Google)

Ncsaustralia

Brisbane

On-site

AUD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Paid parental leave
Discounted health insurance
Career development programs
Product/service discounts

Job summary

NCS Australia is seeking an experienced Data Engineer to design and scale our massive, reliable data infrastructure across the organization. You will build end-to-end data pipelines in GCP, optimize BigQuery data models, and collaborate with data scientists and engineers to enable data-driven decision making.

You will tackle petabyte-scale challenges, implement CI/CD for data workflows, and advocate data quality, security, and governance while leveraging tools like Dataflow, Pub/Sub, and

Qualifications

  • Experience with Google Cloud Platform (GCP) data services and BigQuery.
  • Strong background in building scalable data pipelines (ETL/ELT) for petabyte-scale workloads.
  • Familiarity with data governance, security, and data quality practices.
  • Experience with real-time streaming data processing (Pub/Sub, Dataflow Streaming).
  • Proficiency in containerization and orchestration (Docker, Kubernetes).

Responsibilities

  • Design, build, test, and maintain scalable data pipelines (ETL/ELT) using Dataflow, Composer, and BigQuery.
  • Architect and optimize data models in BigQuery for performance and cost efficiency.
  • Collaborate with Data Scientists, Analysts, and Software Engineers to ensure data quality and security.
  • Monitor, troubleshoot, and continuously improve production data systems and CI/CD for data pipelines.
  • Explore new data technologies and cloud services to enhance architecture and governance.

Skills

BigQuery
Dataflow
Pub/Sub
Cloud Composer
Data modeling

Tools

Docker
Kubernetes
Terraform
Python
Git
Bash

Job description

This role is responsible for building and scaling the massive, reliable data infrastructure that powers critical decisions, product features, and advanced analytics across our organization-impacting billions of users daily. As a Data Engineer, you will be a core architect and builder of our next-generation data pipelines, transforming raw, high-volume data into structured, actionable insights. You will design, construct, implement, and rigorously manage end-to-end data processing systems, focusing on robustness, efficiency, security, and high throughput. Your challenge will be to translate complex, ambiguous business requirements from product managers and data scientists into scalable, fault-tolerant solutions using cutting-edge Google Cloud Platform (GCP) technologies. This includes deep involvement with services like BigQuery, Dataflow, Cloud Composer, and Pub/Sub. Your contributions will be instrumental in enabling data-driven optimization across areas such as product development, machine learning model training, and operational efficiency, making you a vital partner in Google's ongoing innovation. We're looking for an engineer ready to tackle petabyte-scale data challenges and champion data quality across the enterprise.

Responsibilities
  • Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
  • Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
  • Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
  • Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
  • Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.
Responsibilities
  • Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
  • Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
  • Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
  • Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
  • Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.

Strong background and experience in Google (GCP) along with a background as a Data Engineer.

Experience with real-time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Experience with version control systems (e.g., Git).

Deep understanding of DataOps principles and automated testing for data quality.

GCP Professional Data Engineer Certification is a plus.

Additional information
  • Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
  • Previous hands on Google Cloud experience
  • Previous experience of working on Federal Government projects
  • Previous experience building infrastructure as code with Terraform at an advanced level
  • Ability to script in at least one of the following languages: Python, Bash
  • Applied knowledge of CI/CD concepts and deployment of platform solutions
  • Solutions experience leveraging GCP-based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
  • Be well-versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
  • Experience designing secure and scalable network architectures on Google Cloud
  • Security-focused with a deep understanding of cloud security principles, threats, and mitigation techniques
  • Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications
Why join us:
  • NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time.
  • Our benefits include paid parental leave, initiatives focused on your well-being and discounted health insurance.
  • You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance.
  • We are committed to your career development through our Capability Fingerprint, industry and partne
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Gcp Data Engineer (Google)
Gcp Data Engineer (Google)

Ncs Australia • Australia

On-site
AUD 120,000 - 160,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer (Google)
GCP Data Engineer (Google)

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
GCP Data Engineer - Contract or Perm
GCP Data Engineer - Contract or Perm

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
Gcp Data Engineer - Contract Or Perm
Gcp Data Engineer - Contract Or Perm

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
GCP Data Engineer - Contract or Perm
GCP Data Engineer - Contract or Perm

NCS • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer
GCP Data Engineer

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software • Sydney

On-site
AUD 120,000 - 150,000
Data Engineer
Data Engineer

TaskVerse • Melbourne

On-site
AUD 120,000 - 180,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
GCP Data Engineer: Build Scalable Data Pipelines
GCP Data Engineer: Build Scalable Data Pipelines

NCS Australia • Melbourne

On-site
AUD 120,000 - 180,000
Paid parental leave
Discounted health insurance
AI-driven learning platform
+1
Top locations