Data Engineer - Real-Time ETL & Big Data on GCP

Hydrogen Group

Sydney

On-site

AUD 166,000 - 203,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

My client in Sydney, Australia, is seeking a Data Engineer to join a team of data experts and project managers on cutting-edge ETL design and Big Data initiatives. You will build reusable ingestion code, populate data lakes, and deliver data curation jobs using CI/CD within a modern data ecosystem.

Key requirements include strong Python, SQL/PL-SQL skills, and hands-on experience with Spark, Kafka, Snowflake, Databricks, Azure and GCP.

Qualifications

  • Experience with Big Data and ETL design in enterprise environments.
  • Proficient in SQL/PL-SQL and data modeling concepts.
  • Hands-on with cloud platforms and modern data tools (Snowflake, Databricks, Spark).

Responsibilities

  • Create repeatable ingestion and curation code per the architecture.
  • Populate Data Lake and data models for new sources.
  • Implement ETL pipelines and CI/CD for data jobs.
  • Ingest structured/unstructured data in real-time, near real-time or batch into the data platform.
  • Ensure production services are configured to protect production data.

Skills

Python
SQL
PL/SQL

Tools

Azure
GCP
Snowflake
Databricks
Spark
Kafka

Job description

My client in Sydney, Australia, is seeking a Data Engineer to join a team of data experts and project managers on cutting-edge ETL design and Big Data initiatives. You will build reusable ingestion code, populate data lakes, and deliver data curation jobs using CI/CD within a modern data ecosystem.

Key requirements include strong Python, SQL/PL-SQL skills, and hands-on experience with Spark, Kafka, Snowflake, Databricks, Azure and GCP.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Data Engineer with GCP
Data Engineer with GCP

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert
GCP Data Engineer: Real-Time Pipelines & BigQuery Expert

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 90,000 - 120,000
Data Engineer
Data Engineer

Hydrogen Group • Sydney

On-site
AUD 166,000 - 203,000
GCP Data Engineer: BigQuery & Real-Time Pipelines
GCP Data Engineer: BigQuery & Real-Time Pipelines

XPT Software • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

NCS • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: ETL, BigQuery & Airflow Expert
GCP Data Engineer: ETL, BigQuery & Airflow Expert

Carecone Group • Sydney

On-site
AUD 120,000 - 180,000
GCP Data Engineer: Real-Time Pipelines & Data Governance
GCP Data Engineer: Real-Time Pipelines & Data Governance

Ncs Australia • Sydney

On-site
AUD 120,000 - 160,000
Google Cloud Data Engineer — Real-Time Pipelines & Governance
Google Cloud Data Engineer — Real-Time Pipelines & Governance

Ncsaustralia • Sydney

On-site
AUD 120,000 - 180,000
Senior Data Engineer: Cloud Data & AI Modernisation
Senior Data Engineer: Cloud Data & AI Modernisation

Talent Insights Group • Sydney

Hybrid
AUD 150,000 - 210,000
Top locations