GCP Data Platform Architect

Ncsaustralia; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

NCS Australia is seeking a GCP Data Engineer to build and scale data pipelines, transforming high-volume data into actionable insights. You will design robust end-to-end data processing systems using Dataflow, BigQuery, Composer, and Pub/Sub, while ensuring security, governance, and high throughput across the organization.

You will collaborate with data scientists, analysts, and software engineers to meet data needs, optimize models, and support petabyte-scale data challenges with an emphasis on

Qualifications

• Strong Google Cloud Platform background with enterprise経験 as a GCP Data Engineer.
• Experience with real-time streaming data using Pub/Sub and Dataflow Streaming.
• Familiarity with containerization/orchestration (Docker, Kubernetes) and Git version control.

Responsibilities

• Design, test, and maintain scalable data pipelines (ETL/ELT) on GCP.
• Architect and optimize BigQuery data models for performance and cost.
• Collaborate with data scientists and engineers to ensure data quality and security.
• Monitor, troubleshoot, and CI/CD data pipelines for reliability and reproducibility.
• Explore new data technologies and cloud services to enhance architecture.

Skills

GCP Data Engineer

Pub/Sub

Dataflow

BigQuery

Kubernetes

Terraform

Python

CI/CD

DataOps

Security

Tools

Dataflow

Composer

BigQuery

Pub/Sub

Terraform

Job description

NCS Australia is seeking a GCP Data Engineer to build and scale data pipelines, transforming high-volume data into actionable insights. You will design robust end-to-end data processing systems using Dataflow, BigQuery, Composer, and Pub/Sub, while ensuring security, governance, and high throughput across the organization.

You will collaborate with data scientists, analysts, and software engineers to meet data needs, optimize models, and support petabyte-scale data challenges with an emphasis on