Data Engineer

Hydrogen Group

Sydney

On-site

AUD 166,000 - 203,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

My client in Sydney, Australia, is seeking a Data Engineer to join a team of data experts and project managers on cutting-edge ETL design and Big Data initiatives. You will build reusable ingestion code, populate data lakes, and deliver data curation jobs using CI/CD within a modern data ecosystem.

Key requirements include strong Python, SQL/PL-SQL skills, and hands-on experience with Spark, Kafka, Snowflake, Databricks, Azure and GCP.

Qualifications

  • Experience with Big Data and ETL design in enterprise environments.
  • Proficient in SQL/PL-SQL and data modeling concepts.
  • Hands-on with cloud platforms and modern data tools (Snowflake, Databricks, Spark).

Responsibilities

  • Create repeatable ingestion and curation code per the architecture.
  • Populate Data Lake and data models for new sources.
  • Implement ETL pipelines and CI/CD for data jobs.
  • Ingest structured/unstructured data in real-time, near real-time or batch into the data platform.
  • Ensure production services are configured to protect production data.

Skills

Python
SQL
PL/SQL

Tools

Azure
GCP
Snowflake
Databricks
Spark
Kafka

Job description

The Client

My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools.

The Role

This role offers a great chance to join a team of Engineering Manager's, Data experts and Project Manager's working on cutting edge, highly complex ETL design and Big Data tools. The position will also give you the chance to gain exposure to a range of other languages/technologies.

The ideal candidate will have experience working on similar projects working heavily with Big Data Tools and ETL design.

  • Create repeatable and reusable ingestion and curation code in accordance with the architecture
  • Populate Data Lake and Data model for new the sources that haven’t been incorporated into big data ecosystem
  • Low level design implementing ETL processes/pipelines where required
  • Delivery of data curation Jobs, including development, testing and implementation using CI/CD framework
  • Ingest structured / unstructured data in Real time, Near real time or batch cadence into GCP
  • Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.
Candidate Profile

Looking for the following skills/experience.

  • Working experience with cloud platforms such as Azure & GCP
  • Strong experience with Python & Snowflake
  • Proven experience building data working with tools such as Spark and Kafka
  • Highly skilled in all aspects of SQL and PL/SQL
  • Low level design or reusable framework experience highly regarded
  • Working experince with tools such Snowflake or Databricks
What's on offer?

This is an excellent opportunity to work on a great contract where you will have access to market leading tools, expert colleagues and a modern working environment. This opportunity offers a competitive daily rate as well as other excellent benefits.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Real-Time ETL & Big Data on GCP
Data Engineer - Real-Time ETL & Big Data on GCP

Hydrogen Group • Sydney

On-site
AUD 166,000 - 203,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Sydney

On-site
AUD 130,000 - 180,000
Data Engineer
Data Engineer

Himanshu Gupta • Brisbane, Gold Coast City

On-site
AUD 110,000 - 160,000
Snowflake Engineer
Snowflake Engineer

Hawksworth Consulting • Sydney

On-site
AUD 150,000 - 190,000
Data Engineer (DBT + Snowflake)
Data Engineer (DBT + Snowflake)

Carecone Group • Sydney

On-site
AUD 150,000 - 195,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Melbourne

On-site
AUD 120,000 - 180,000
Mid-Senior Data Engineer (Multiple Vacancies)
Mid-Senior Data Engineer (Multiple Vacancies)

seek.com.au • Sydney

On-site
AUD 120,000 - 180,000
AWS Data Engineering Lead
AWS Data Engineering Lead

TRC Group • Sydney

On-site
AUD 180,000 - 230,000
AWS Data Engineering Lead
AWS Data Engineering Lead

The Recruitment Company • Sydney

On-site
AUD 140,000 - 180,000
Snowflake Engineer
Snowflake Engineer

Hawksworth Consulting • Sydney

On-site
AUD 140,000 - 210,000
Top locations