Data Engineer-GCP

XPT Software; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

XPT Software in Australia seeks a senior data engineer with strong GCP experience to design and implement scalable data solutions using BigQuery, Dataflow and Pub/Sub.

You will build batch and streaming ETL/ELT pipelines, optimize data warehousing models (star/snowflake) and collaborate with cross-functional teams to deliver real-time analytics for clients in Banking, Insurance and more.

Qualifications

• Strong GCP Data Services Expertise with BigQuery, Dataflow, Pub/Sub, Cloud Storage; design scalable data solutions using native GCP tools.
• Experience in Data Pipeline Development (Batch & Streaming); building and maintaining ETL/ELT pipelines; real-time streaming and batch processing.
• Strong Programming & Query Skills in Python and SQL; experience with data processing frameworks like Apache Beam or Spark.
• Understanding of Data Modeling & Warehousing; strong understanding of data modeling (star/snowflake schemas); experience designing and optimizing data warehouses (BigQuery).

Skills

GCP Data Services

Data Pipeline Development

Programming & Query

Data Modeling & Warehousing

BigQuery

Dataflow

Pub/Sub

Python

SQL

Apache Beam

Spark

Kafka

Docker

Kubernetes

GKE

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Apache Beam

Spark

Job description

• XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
  
• XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
  
• We have 120+technocrats in Australia working at our clientlocations.
  
• XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
  
• We have served100+ clients globally, fulfilling their onsite-offshoreneeds.
  

Must Have Skills:

• StrongGCP Data Services Expertise - Hands-on experiencewith BigQuery, Dataflow, Pub/Sub, Cloud Storage, Ability to design scalabledata solutions using native GCP tools.
• Experience in Data Pipeline Development (Batch & Streaming) - Building and maintaining ETL/ELT pipelines, Experience with real-timestreaming and batch processing.
• Strong Programming & Query Skills - Proficiencyin Python and SQL, Experience with data processing frameworks like ApacheBeam or Spark
• Understanding of Data Modeling & Warehousing - Strongunderstanding of data modeling (star/snowflake schemas), Experience designingand optimizing data warehouses (BigQuery)

Nice to Have Skills:

• Experience in Multi-Cloud Exposure : Understanding of cross-cloud data integration and migration, Experienceworking with AWS or Azure alongside GCP
• Knowledge of Streaming & Messaging Frameworks : Experience with Kafka or advanced Pub/Sub patterns, Knowledge ofreal-time data architectures
• Basic Understanding of Containerization & Orchestration : Hands-on with Docker and Kubernetes (GKE),Ability to deploy and manage data workloads in containerized environments
• DataGovernance & Security : Familiarity with datalineage, cataloging, and governance tools, Understanding of IAM roles,data security, and compliance in GCP.