GCP Data Engineer: Real-Time Pipelines & Data Governance

NCS Australia; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

NCS Australia is seeking a GCP Data Engineer to design and support secure, scalable data pipelines on Google Cloud Platform. You will handle real-time streaming and batch processing, integrate upstream data sources, and ensure data is accessible to the right people with proper security controls.

You’ll combine hands-on data engineering with governance, addressing data ingestion challenges and building reliable, well‑controlled data solutions for clients and internal teams.

Qualifications

• Practical experience building real-time streaming and batch data pipelines.

Responsibilities

• Develop and maintain real-time streaming and batch pipelines on Google Cloud (Dataflow, BigQuery).
• Build and manage transformation workflows (Dataform) and orchestrate processes (Workflows, Eventarc, Cloud Run).
• Ingest upstream data sources, investigate dependencies and resolve integration challenges.
• Implement data redaction, RBAC/RLS, CLS, taxonomies and policy tags to protect sensitive data.
• Apply data governance mechanisms to align data access with business/security requirements.

Skills

Real-time streaming

Batch processing

Data governance

Troubleshooting data pipelines

Tools

Dataflow

Dataform

Workflows

Eventarc

Cloud Run

BigQuery

Job description

NCS Australia is seeking a GCP Data Engineer to design and support secure, scalable data pipelines on Google Cloud Platform. You will handle real-time streaming and batch processing, integrate upstream data sources, and ensure data is accessible to the right people with proper security controls.

You’ll combine hands-on data engineering with governance, addressing data ingestion challenges and building reliable, well‑controlled data solutions for clients and internal teams.