GCP Data Engineer: Build Scalable Cloud Data Pipelines

Insignia Financial; City of Hobart; On-site; AUD 120,000 - 160,000; Full time

Job summary

Insignia Financial is expanding its Data Engineering team in Hobart to design, build, and optimise scalable data platforms on Google Cloud Platform, powering insights and digital experiences across the organisation.

As a GCP Data Engineer, you will work with BigQuery, Dataflow, Pub/Sub, and Cloud Composer, applying DevOps practices to deliver reliable data solutions in a cloud-native environment.

Qualifications

• 3+ years of data or software engineering experience.
• Strong hands-on experience with Google Cloud Platform services (BigQuery, Dataflow, Pub/Sub, Cloud Composer).
• Proficiency in Java or Python and building production-grade data pipelines.
• Experience with DevOps, CI/CD, Infrastructure as Code, and automated testing frameworks.

Responsibilities

• Design scalable data solutions on Google Cloud Platform such as BigQuery, Dataflow, and Composer.
• Build and maintain batch and real-time data pipelines using modern engineering practices.
• Apply DevOps principles, including CI/CD, IaC (Terraform), and automated testing to improve delivery.
• Ensure data quality through validation, monitoring, governance controls, and adherence to engineering standards.
• Optimise data pipelines and storage solutions for performance, scalability, reliability, and cost efficiency.
• Monitor, troubleshoot, and support solutions during build, driving continuous improvements.
• Implement security controls, access management processes, and compliance requirements across data platforms.

Skills

Google Cloud Platform

Java

Python

CI/CD

DevOps

Education

Tertiary qualification in Computer Science/Information Technology

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Composer

Job description

Insignia Financial is expanding its Data Engineering team in Hobart to design, build, and optimise scalable data platforms on Google Cloud Platform, powering insights and digital experiences across the organisation.

As a GCP Data Engineer, you will work with BigQuery, Dataflow, Pub/Sub, and Cloud Composer, applying DevOps practices to deliver reliable data solutions in a cloud-native environment.