Senior AWS Data Engineer – Secure Pipelines & ML Enablement

The Recruitment Hive Pty Ltd; Sydney; Vor Ort; AUD 140.000 - 180.000; Vollzeit

Zusammenfassung

The Recruitment Hive Pty Ltd is seeking a Senior AWS Data Engineer in Sydney (Surry Hills) to design, build and maintain scalable data pipelines for analytics, ML and AI use cases. The role focuses on curated data products, data quality and efficient cloud workloads.

You will translate business requirements into robust technical designs, implement IaC with Terraform or CloudFormation, and deliver DevOps‑minded data solutions using Python and SQL in containerised environments such as Docker, ECS

Qualifikationen

• Senior AWS Data Engineer with extensive AWS data integration experience.
• Experience delivering data pipelines for analytics, ML/AI use cases.
• Proficient in ETL/ELT patterns, data quality, metadata and lineage.
• Hands-on in DevOps practices, including Git, CI/CD and automated testing.

Aufgaben

• Design, build, test and maintain scalable data pipelines for analytics, ML and AI use cases.
• Develop curated datasets and data products from structured and unstructured sources.
• Productionise data preparation, feature engineering and model inputs/outputs pipelines.
• Translate business requirements into technical designs.
• Implement automated data quality controls.
• Optimize SQL, Python and cloud workloads; apply IaC and CI/CD.

Kenntnisse

AWS Data Engineering

Data pipelines

Python programming

SQL optimization

Git & CI/CD

Terraform

CloudFormation

Docker

ECS/EKS

Snowflake

Databricks

Redshift

Spark

dbt

MLOps/DataOps

SAS Base Programming

Tools

S3

Glue

Lambda

Athena

EMR

Kinesis

Step Functions

Jobbeschreibung

The Recruitment Hive Pty Ltd is seeking a Senior AWS Data Engineer in Sydney (Surry Hills) to design, build and maintain scalable data pipelines for analytics, ML and AI use cases. The role focuses on curated data products, data quality and efficient cloud workloads.

You will translate business requirements into robust technical designs, implement IaC with Terraform or CloudFormation, and deliver DevOps‑minded data solutions using Python and SQL in containerised environments such as Docker, ECS