Senior Data Engineer – Spark on AWS | Cloud Data Pipelines

NOVON; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

Novon in Sydney is seeking experienced Senior Data Engineers to join our Data Practice and support a major data transformation program for a leading financial services organisation. You will help migrate and modernise hundreds of bespoke data pipelines and build scalable, cloud-native data solutions on AWS.

You will work with architects, analysts and stakeholders to deliver reliable data platforms, implement data quality and monitoring, and drive continuous improvement across ETL/ELT processes.

Qualifications

• 8–10+ years of data engineering in enterprise environments.
• Hands-on pipelines with Spark and PySpark.
• Strong AWS data ecosystem knowledge (Glue, S3, Airflow, DBT, Starburst/Presto).

Responsibilities

• Design, build, and optimise data pipelines using Spark / PySpark.
• Design, develop and maintain AWS-native data solutions (Glue, S3, Airflow, DBT, Starburst/Presto).
• Migrate and modernise legacy data pipelines at scale.
• Develop robust ETL and ELT processes with modern practices.
• Collaborate with architects and stakeholders to deliver reliable data platforms.

Skills

Data engineering

Cloud architectures

ETL/ELT

Stakeholder communication

Tools

Spark

PySpark

AWS

Glue

S3

Airflow

DBT

Presto/Starburst

Job description

Novon in Sydney is seeking experienced Senior Data Engineers to join our Data Practice and support a major data transformation program for a leading financial services organisation. You will help migrate and modernise hundreds of bespoke data pipelines and build scalable, cloud-native data solutions on AWS.

You will work with architects, analysts and stakeholders to deliver reliable data platforms, implement data quality and monitoring, and drive continuous improvement across ETL/ELT processes.