SENIOR DATA ENGINEER

Sirius.; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

Sirius Technology is recruiting a Senior Data Engineer to design, build and maintain data pipelines across an AWS-based data platform in Sydney. The role focuses on reliability, accessibility and well-structured data to support analytics, APIs and AI initiatives.

You will work on ETL/ELT processes with AWS Glue, PySpark, Lambda and dbt, optimize data models in Redshift, and ensure high-quality data ingestion from databases, APIs, files and event-driven sources in a fast-paced environment.

Qualifications

• Extensive experience designing, building and supporting AWS-based data platforms.

Responsibilities

• Design, build and maintain scalable data pipelines and integration solutions across the AWS data platform.
• Develop and support ETL/ELT processes using AWS Glue, PySpark, Lambda and dbt.
• Design and optimise data models within Redshift to support reporting, analytics and wider business requirements.
• Lead the ingestion and integration of data from databases, APIs, files and event-driven sources.
• Monitor, troubleshoot and optimise data pipelines to ensure data quality, reliability and performance.
• Implement and maintain metadata, data lineage and governance practices through DataHub and related tools.

Skills

AWS data platforms

PySpark

Python

SQL

Power BI

dbt

ETL/ELT pipelines

Data modelling

APIs

Tools

AWS Glue

AWS Lambda

ECS/Fargate

Redshift

S3

dbt

DataHub

Job description

SENIOR DATA ENGINEER | AWS, PYSPARK, PYTHON, DBT | 12-MONTH CONTRACT (EXTENDABLE) | SYDNEY | 2 DAYS ONSITE

Sirius Technology is working with an end-user operating across research, development and marketing services. They are looking for a Senior Data Engineer to design, build and maintain data pipelines and integration solutions across their modern AWS-based data platform.

You will play a key role in ensuring data is reliable, accessible and well-structured to support analytics, API integrations and AI initiatives.

Responsibilities

• Design, build and maintain scalable data pipelines and integration solutions across the AWS data platform.
• Develop and support ETL/ELT processes using AWS Glue, PySpark, Lambda and dbt.
• Design and optimise data models within Redshift to support reporting, analytics and wider business requirements.
• Lead the ingestion and integration of data from databases, APIs, files and event-driven sources.
• Monitor, troubleshoot and optimise data pipelines to ensure data quality, reliability and performance.
• Implement and maintain metadata, data lineage and governance practices through DataHub and related tools.

Skills

• Extensive experience designing, building and supporting AWS-based data platforms.
• Strong hands-on experience with AWS Glue, PySpark, Lambda, ECS/Fargate, Redshift and S3.
• Advanced SQL and Python development skills and Power BI.
• Experience with dbt, data modelling and ETL/ELT pipeline development.
• Experience building data ingestion, integration and API-based solutions at scale.
• Comfortable using AI-assisted development tools, with an interest in applying AI within data engineering.

Applicants must be an Australian Citizen or Permanent Resident.

Many thanks, Jake Johal