GCP Data Engineer: Scale Data Pipelines & Insights

NCS Group Australia; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

NCS Australia is seeking a skilled GCP Data Engineer to design and scale data pipelines on Google Cloud. You will transform raw, high-volume data into structured, actionable insights while ensuring robustness, security, and high throughput.

Collaborate with data scientists and engineers to optimize analytics, ML training pipelines, and product features across the enterprise. Join a team focused on innovation, data quality, and scalable cloud architectures in Sydney.

Qualifications

• Strong background and experience in Google (GCP) along with a background as a GCP Data Engineer.
• Experience with real-time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.
• Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Experience with version control systems (e.g., Git).
• Deep understanding of DataOps principles and automated testing for data quality.
• Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
• Previous experience building infrastructure as code with Terraform at an advanced level
• Ability to script in at least one of the following languages: Python, Bash
• Applied knowledge of CI/CD concepts and deployment of platform solutions
• Solutions experience leveraging GCP-based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
• Be well-versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
• Experience designing secure and scalable network architectures on Google Cloud
• Security-focused with a deep understanding of cloud security principles, threats, and mitigation techniques
• Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications

Responsibilities

• Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
• Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
• Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
• Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for CI/CD of data pipelines.
• Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.

Skills

GCP Data Engineering

Streaming data processing

Python

Bash

Terraform

CI/CD concepts

DataOps

Security principles

Networking concepts

BigQuery

Dataflow

Pub/Sub

Kubernetes

Docker

Git

Education

Google Cloud Professional Certification (Cloud Architect, Cloud DevOps Engineer, Cloud Developer)

Tools

BigQuery

Dataflow

Cloud Composer

Pub/Sub

Terraform

Docker

Kubernetes

Compute Engine

App Engine

Cloud Storage

Git

Job description

NCS Australia is seeking a skilled GCP Data Engineer to design and scale data pipelines on Google Cloud. You will transform raw, high-volume data into structured, actionable insights while ensuring robustness, security, and high throughput.

Collaborate with data scientists and engineers to optimize analytics, ML training pipelines, and product features across the enterprise. Join a team focused on innovation, data quality, and scalable cloud architectures in Sydney.