Senior Data Engineer – AWS/PySpark | 2 Days Onsite Sydney

Sirius.; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

Sirius Technology is recruiting a Senior Data Engineer to design, build and maintain data pipelines across an AWS-based data platform in Sydney. The role focuses on reliability, accessibility and well-structured data to support analytics, APIs and AI initiatives.

You will work on ETL/ELT processes with AWS Glue, PySpark, Lambda and dbt, optimize data models in Redshift, and ensure high-quality data ingestion from databases, APIs, files and event-driven sources in a fast-paced environment.

Qualifications

• Extensive experience designing, building and supporting AWS-based data platforms.

Responsibilities

• Design, build and maintain scalable data pipelines and integration solutions across the AWS data platform.
• Develop and support ETL/ELT processes using AWS Glue, PySpark, Lambda and dbt.
• Design and optimise data models within Redshift to support reporting, analytics and wider business requirements.
• Lead the ingestion and integration of data from databases, APIs, files and event-driven sources.
• Monitor, troubleshoot and optimise data pipelines to ensure data quality, reliability and performance.
• Implement and maintain metadata, data lineage and governance practices through DataHub and related tools.

Skills

AWS data platforms

PySpark

Python

SQL

Power BI

dbt

ETL/ELT pipelines

Data modelling

APIs

Tools

AWS Glue

AWS Lambda

ECS/Fargate

Redshift

S3

dbt

DataHub

Job description

Sirius Technology is recruiting a Senior Data Engineer to design, build and maintain data pipelines across an AWS-based data platform in Sydney. The role focuses on reliability, accessibility and well-structured data to support analytics, APIs and AI initiatives.

You will work on ETL/ELT processes with AWS Glue, PySpark, Lambda and dbt, optimize data models in Redshift, and ensure high-quality data ingestion from databases, APIs, files and event-driven sources in a fast-paced environment.