Senior AWS Data Engineer

The Recruitment Hive Pty Ltd; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

The Recruitment Hive Pty Ltd is seeking a Senior AWS Data Engineer in Sydney (Surry Hills) to design, build and maintain scalable data pipelines for analytics, ML and AI use cases. The role focuses on curated data products, data quality and efficient cloud workloads.

You will translate business requirements into robust technical designs, implement IaC with Terraform or CloudFormation, and deliver DevOps‑minded data solutions using Python and SQL in containerised environments such as Docker, ECS

Qualifications

• Senior AWS Data Engineer with extensive AWS data integration experience.
• Experience delivering data pipelines for analytics, ML/AI use cases.
• Proficient in ETL/ELT patterns, data quality, metadata and lineage.
• Hands-on in DevOps practices, including Git, CI/CD and automated testing.

Responsibilities

• Design, build, test and maintain scalable data pipelines for analytics, ML and AI use cases.
• Develop curated datasets and data products from structured and unstructured sources.
• Productionise data preparation, feature engineering and model inputs/outputs pipelines.
• Translate business requirements into technical designs.
• Implement automated data quality controls.
• Optimize SQL, Python and cloud workloads; apply IaC and CI/CD.

Skills

AWS Data Engineering

Data pipelines

Python programming

SQL optimization

Git & CI/CD

Terraform

CloudFormation

Docker

ECS/EKS

Snowflake

Databricks

Redshift

Spark

dbt

MLOps/DataOps

SAS Base Programming

Tools

S3

Glue

Lambda

Athena

EMR

Kinesis

Step Functions

Job description

• Baseline Security Clearance - Surry Hills, NSW

Our client, a Federal Government statutory authority based in Surry Hills, NSW, requires the services of a Senior AWS Data Engineer for a 12 + 12 month contract.

Duties of the Senior AWS Data Engineer:

• Design, build, test and maintain scalable batch and event-driven data pipelines for analytics, machine learning and AI use cases.
• Develop curated, reusable and well-documented datasets and data products from structured and unstructured sources.
• Productionise data preparation, feature engineering, model input and model output pipelines.
• Translate business and analytical requirements into technical designs.
• Implement automated data quality controls.
• Optimise SQL, Python and cloud workloads.
• Apply IaaC, version control, automated testing, CI/CD etc.

Skills and Experience - Senior AWS Data Engineer:

• Demonstrated experience designing and delivering in AWS, using S3, Glue, Lambda, Athena, EMR, Kinesis, Step Functions etc.
• Strong experience with ETL/ELT patterns, data modelling, orchestration, data quality testing, metadata and lineage across structured and unstructured data.
• Experience with DevOps practices, including Git, code review, automated testing, CI/CD.
• Experience with IaaCusing Terraform or AWS CloudFormation.
• Strong programming capability in Python.
• Advanced SQL skills.
• Hands-on experience delivering cloud-based data solutions in containerised environments such as Docker, ECS or EKS.
• Experience supporting data science, machine learning, generative AI.
• Experience with Snowflake, Databricks, Redshift, Spark or dbt.
• Knowledge of MLOps or DataOps practices.
• SAS Base Programming.

Please note that applications close at 11am on the 5th of November 2026. Recruitment Hive welcome late applications to be considered for future opportunities.

We Value Diversity

The Recruitment Hive is a proud Equal Opportunity Employer. We recognise the value of diverse perspectives and experience and are committed to an inclusive workplace where everyone feels valued and respected for who they are. We encourage people with disability, indigenous, veterans and people of all backgrounds and abilities to express their interest in this role.