GCP Data Engineer

Carecone Group; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Carecone Group in Sydney, Australia, seeks a GCP Data Engineer to design and implement scalable ETL/ELT pipelines and cloud-native data solutions. You will work with BigQuery, Dataform, Cloud Composer and Data Storage to deliver secure, compliant data platforms.

You will lead data migrations, optimize SQL performance, and collaborate in an Agile environment using CI/CD practices. Familiarity with Databricks, DLP, and integrations with ServiceNow/Salesforce is a plus.

Qualifications

• Strong Python and API Integration skills (REST, JSON/XML, OAuth, error handling).
• Hands-on with GCP services: BigQuery, Dataform, Cloud Composer, Pub/Sub, Cloud Storage.
• Experience designing scalable ETL/ELT pipelines and cloud-native data solutions.
• Strong Data Warehousing understanding, dimensional modelling, and data lifecycle management.
• Experience delivering data migration projects with validation and reconciliation.
• Hands-on with Cloud DLP, data governance, security and compliance requirements.
• Advanced SQL with performance tuning and complex transformations.
• Terraform for IaC and GCP deployment.
• Familiarity with CI/CD, Agile delivery, and enterprise integration patterns.
• Nice to have: Databricks, Data Quality, ServiceNow/Salesforce integrations, and JIRA.

Responsibilities

• Design and implement scalable ETL/ELT pipelines on GCP.
• Develop and maintain DAGs in Airflow/Cloud Composer for data workflows.
• Ensure data governance, security and compliance in cloud data solutions.
• Lead data migration initiatives with data validation and reconciliation.
• Collaborate across teams in Agile environments to deliver integrated data platforms.

Skills

Python

SQL

ETL/ELT pipelines

Data Warehousing

GCP

Airflow

BigQuery

Dataform

Terraform

CI/CD

JIRA

Data Migration

DLP/Security

Tools

Databricks

ServiceNow/Salesforce integrations

JIRA

Cloud Composer

Job description

Role : GCP Data Engineer
Type of role - Permanent Position
Location : Sydney, Australia

Job Description

• Strong expertise in Python and API Integration (REST APIs, JSON/XML, OAuth, error handling, and data ingestion frameworks).
• Hands on experience with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Secure Source Manager, Cloud Storage and Pub/Sub.
• Proven experience designing and implementing scalable ETL/ELT pipelines and cloud native data solutions.
• Strong understanding of Data Warehousing, dimensional modelling, and data lifecycle management.
• Experience delivering large scale Data Migration projects with data validation and reconciliation.
• Hands on experience with Cloud DLP, data governance, security, and compliance requirements.
• Advanced SQL skills, including performance tuning and complex data transformations.
• Experience using Terraform for Infrastructure as Code (IaC) and GCP resource deployment.
• Familiarity with CI/CD pipelines, Agile delivery practices, and enterprise integration patterns.
• Good to Have: Databricks, Data Quality, ServiceNow/Salesforce integrations and JIRA.