GCP Data Engineer: Build Scalable Cloud Data Pipelines

Insignia Financial; City of Brisbane; On-site; AUD 120,000 - 155,000; Full time

Job summary

Insignia Financial is expanding its Data Engineering team to build modern data platforms powering insights and digital experiences across the organisation. As a GCP Data Engineer, you will design, develop, and optimise scalable data solutions on Google Cloud Platform, handling large datasets in a cloud-native environment.

You will work with BigQuery, Dataflow, Pub/Sub, and Cloud Composer, implement CI/CD and IaC practices, and contribute to a culture of continuous improvement and innovation.

Qualifications

• 3+ years of experience in data engineering or related field.
• Hands-on with Google Cloud Platform services (BigQuery, Dataflow, Pub/Sub, Cloud Composer).
• Proficiency in Java or Python and building production-grade data pipelines.
• Experience with DevOps practices, CI/CD pipelines, Infrastructure as Code, and automated testing.

Responsibilities

• Design and implement scalable data solutions using Google Cloud Platform services (BigQuery, Dataflow, Composer).
• Build and maintain batch and real-time data pipelines.
• Apply DevOps principles, including CI/CD and IaC (Terraform).
• Ensure data quality with validation, monitoring, governance controls.
• Optimise data pipelines for performance, scalability, reliability and cost.
• Monitor, troubleshoot, and support solutions during build and drive improvements.
• Implement security controls and access management across data platforms.

Skills

BigQuery

Dataflow

Pub/Sub

Cloud Composer

Java

Python

CI/CD

Terraform

Data pipelines

Education

Bachelor's degree in Computer Science or Information Technology

Tools

Terraform

CI/CD tooling

Job description

Insignia Financial is expanding its Data Engineering team to build modern data platforms powering insights and digital experiences across the organisation. As a GCP Data Engineer, you will design, develop, and optimise scalable data solutions on Google Cloud Platform, handling large datasets in a cloud-native environment.

You will work with BigQuery, Dataflow, Pub/Sub, and Cloud Composer, implement CI/CD and IaC practices, and contribute to a culture of continuous improvement and innovation.