Senior GCP Data Engineer | ETL, BigQuery & Airflow

CareCone Group; Sydney; On-site; AUD 120,000 - 165,000; Full time

Job summary

CareCone Group is seeking a GCP Data Engineer for our client in Sydney. You will design and implement scalable data pipelines using GCP services such as BigQuery, Dataform, and Cloud Composer, and integrate data from REST APIs, JSON/XML, and OAuth secured sources.

You will also optimize data warehouses, manage data governance and security, and contribute to CI/CD and Agile delivery in a collaborative enterprise environment.

Qualifications

• 5 to 8+ years of experience as a GCP Data Engineer.
• Strong Python and API integration with REST APIs, JSON/XML, OAuth.
• Hands-on with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Pub/Sub.
• Solid understanding of data warehousing, dimensional modelling and data lifecycle management.
• Experience delivering large-scale data migration projects with data validation.
• Experience with data governance, security and compliance requirements.
• Advanced SQL skills with performance tuning and complex transformations.
• Familiarity with IaC using Terraform and CI/CD in an Agile environment.
• Nice-to-have: Databricks, ServiceNow/Salesforce integrations, and JIRA.

Skills

Python

APIs

ETL/ELT

GCP

BigQuery

Dataform

Airflow

DAGs

Data governance

Security/compliance

SQL

Terraform

CI/CD

Agile

Databricks

Salesforce integration

JIRA

Tools

BigQuery

Dataform

Cloud Composer

Terraform

Job description

CareCone Group is seeking a GCP Data Engineer for our client in Sydney. You will design and implement scalable data pipelines using GCP services such as BigQuery, Dataform, and Cloud Composer, and integrate data from REST APIs, JSON/XML, and OAuth secured sources.

You will also optimize data warehouses, manage data governance and security, and contribute to CI/CD and Agile delivery in a collaborative enterprise environment.