Senior Data Engineer

Humanised Group

Sydney

Hybrid

AUD 137,760 - 172,200

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading recruitment consultancy is seeking a Data Engineer for a 3-month contract in Sydney. This hybrid role involves building data pipelines with Python and PySpark, managing Delta Lake layers in Databricks, and automating AWS workflows. Candidates must have strong coding skills and experience with cloud technologies. Competitive pay in the range of A$100-A$125/hr is offered.

Qualifications

Strong knowledge of Python and PySpark is essential.
Familiarity with Databricks and Delta Lake is required.
Experience with AWS services such as Glue and S3 is necessary.

Responsibilities

Build and improve data pipelines using Python and PySpark.
Design and manage Delta Lake layers in Databricks.
Set up and maintain Databricks workflows and jobs.

Skills

Strong coding in Python

Strong coding in PySpark

Experience with Databricks

Experience in AWS services (S3, Glue, Lambda)

Experience using Terraform

Automating AWS tasks with Boto3

Building efficient, secure pipelines

Comfortable in cross-functional teams

Databricks certification

Experience in fast-paced environments

Job description

This range is provided by Humanised Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

A$100.00/hr - A$125.00/hr

Direct message the job poster from Humanised Group

Recruitment Consultant | Data Analytics & AI | Data Mornings - Helping Data Professionals Network & Grow

3 Month Contract | Hybrid Environment | Must be Sydney Based

If you are someone who enjoys designing scalable data pipelines and building modern, high performance data platforms, this is a great opportunity!

We are partnering with a global tech consultancy to find a Data Engineer for an initial 3 month contract.

Responsibilities:

Build/ improve data pipelines using Python and PySpark for both batch and streaming workloads
Design and manage Delta Lake layers (Bronze, Silver, Gold) -Databricks
Set up and maintain Databricks workflows, jobs, notebooks, and DLT pipelines
Optimise performance using Databricks tools and follow best practices for clean, modular code
Work with AWS S3 to manage raw and processed data securely
Use Terraform and Databricks Asset Bundles
Automate AWS workflows using Boto3 (S3, Glue, Lambda)
Work with data scientists and engineers to keep data flowing across teams
Apply place checks for data quality, validation, and monitoring

Required Skills & Experience:

Strong coding in Python and PySpark
Experience with Databricks and Delta Lake
experience in AWS services, especially S3, Glue, Lambda, and Redshift
Experience using Terraform or CloudFormation
Comfortable automating AWS tasks with Boto3
prior experience building efficient, secure, and scalable pipelines
Works well in cross functional and remote teams
Databricks certification
Experience working in consultancies or fast paced delivery environments

Seniority level

Seniority level
Mid-Senior level

Employment type

Employment type
Contract

Job function

Job function
Information Technology
Industries
Staffing and Recruiting

Referrals increase your chances of interviewing at Humanised Group by 2x