GCP Data Engineer: BigQuery + Dataflow Architect

NCS Group Australia; City of Brisbane; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Parental leave

Health insurance

Learning platform

Discounts

Job summary

NCS Australia is building and scaling massive data infrastructure to power critical decisions across the organization. You will design end‑to‑end data pipelines in GCP, transforming raw data into actionable insights used by product teams and data scientists.

As a Data Engineer, you’ll work with BigQuery, Dataflow, Pub/Sub and adjacent technologies, championing data quality, security, and scalable architectures in a fast‑moving environment.

Qualifications

• Strong background and experience in Google (GCP)
• Experience with real‑time streaming data processing using Pub/Sub and Dataflow Streaming
• Familiarity with containerisation and orchestration tools (Docker, Kubernetes)
• Experience with version control systems (Git)
• DataOps principles and automated testing for data quality

Responsibilities

• Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using Dataflow, Composer, and BigQuery
• Infrastructure Management: Architect and optimise data models within BigQuery for performance and cost efficiency
• Collaboration: Work with Data Scientists, Analysts, and Software Engineers to ensure data quality and security
• Operational Excellence: Monitor and troubleshoot production data systems with CI/CD practices
• Innovation: Explore and recommend new data technologies and cloud services

Skills

Data engineering

GCP expertise

CI/CD

Data quality

Data governance

Education

GCP Certification (Professional Data Engineer)

Tools

BigQuery

Dataflow

Cloud Composer

Pub/Sub

Terraform

Docker

Kubernetes

Git

Job description

NCS Australia is building and scaling massive data infrastructure to power critical decisions across the organization. You will design end‑to‑end data pipelines in GCP, transforming raw data into actionable insights used by product teams and data scientists.

As a Data Engineer, you’ll work with BigQuery, Dataflow, Pub/Sub and adjacent technologies, championing data quality, security, and scalable architectures in a fast‑moving environment.