Data Engineer- GCP

CareCone Group; Sydney; On-site; AUD 120,000 - 165,000; Full time

Job summary

CareCone Group is seeking a GCP Data Engineer for our client in Sydney. You will design and implement scalable data pipelines using GCP services such as BigQuery, Dataform, and Cloud Composer, and integrate data from REST APIs, JSON/XML, and OAuth secured sources.

You will also optimize data warehouses, manage data governance and security, and contribute to CI/CD and Agile delivery in a collaborative enterprise environment.

Qualifications

• 5 to 8+ years of experience as a GCP Data Engineer.
• Strong Python and API integration with REST APIs, JSON/XML, OAuth.
• Hands-on with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Pub/Sub.
• Solid understanding of data warehousing, dimensional modelling and data lifecycle management.
• Experience delivering large-scale data migration projects with data validation.
• Experience with data governance, security and compliance requirements.
• Advanced SQL skills with performance tuning and complex transformations.
• Familiarity with IaC using Terraform and CI/CD in an Agile environment.
• Nice-to-have: Databricks, ServiceNow/Salesforce integrations, and JIRA.

Skills

Python

APIs

ETL/ELT

GCP

BigQuery

Dataform

Airflow

DAGs

Data governance

Security/compliance

SQL

Terraform

CI/CD

Agile

Databricks

Salesforce integration

JIRA

Tools

BigQuery

Dataform

Cloud Composer

Terraform

Job description

Hello Professionals ! We are looking for an GCP Data Engineer for one of our Client based in Sydney.

GCP Engineer (5 to 8+ Years Experience)

• Strong expertise in Python and API Integration (REST APIs, JSON/XML, OAuth, error handling, and data ingestion frameworks).
• Hands on experience with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Secure Source Manager, Cloud Storage and Pub/Sub.
• Proven experience designing and implementing scalable ETL/ELT pipelines and cloud native data solutions.
• Strong understanding of Data Warehousing, dimensional modelling, and data lifecycle management.
• Experience delivering large scale Data Migration projects with data validation and reconciliation.
• Hands on experience with Cloud DLP, data governance, security, and compliance requirements.
• Advanced SQL skills, including performance tuning and complex data transformations.
• Experience using Terraform for Infrastructure as Code (IaC) and GCP resource deployment.
• Familiarity with CI/CD pipelines, Agile delivery practices, and enterprise integration patterns.
• Good to Have: Databricks, Data Quality, ServiceNow/Salesforce integrations and JIRA.