GCP Data Engineer: Real-Time & Batch Data Pipelines

Insignia Financial; Sydney; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Career development in GCP

Collaborative team environment

Job summary

Insignia Financial is expanding its Data Engineering team to design, develop, and optimise scalable data solutions on Google Cloud Platform. You will work with large datasets in a cloud-native environment, contributing to a culture of continuous improvement and innovation.

We seek an engineer with 3+ years in data engineering, strong GCP experience, and proficiency in Java or Python. You will build robust data pipelines and apply DevOps practices to enhance delivery and reliability.

Qualifications

• 3+ years of experience in data engineering or related field.
• GCP services experience (BigQuery, Dataflow, Pub/Sub, Cloud Composer).
• Proficiency in Java or Python and building scalable data pipelines.
• Experience with DevOps practices, CI/CD, IaC, and automated testing.

Responsibilities

• Design and implement scalable data solutions on Google Cloud Platform.
• Build and maintain batch and real-time data pipelines.
• Apply DevOps principles to improve delivery efficiency and quality.
• Ensure data quality with governance, validation, and monitoring.

Skills

Java or Python

DevOps practices

Data engineering

Production-grade pipelines

Education

Tertiary qualification in Computer Science/Information Technology

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Composer

Job description

Insignia Financial is expanding its Data Engineering team to design, develop, and optimise scalable data solutions on Google Cloud Platform. You will work with large datasets in a cloud-native environment, contributing to a culture of continuous improvement and innovation.

We seek an engineer with 3+ years in data engineering, strong GCP experience, and proficiency in Java or Python. You will build robust data pipelines and apply DevOps practices to enhance delivery and reliability.