Senior Data Engineer - Cloud Data

Whizdom; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

Whizdom is seeking a Senior Data Engineer to lead cloud data modernisation efforts in Sydney, migrating legacy SQL Server platforms to AWS-native services and modernising analytics workloads. The role requires strong SQL skills, data modelling, and experience delivering ETL pipelines in a cloud environment.

You will design scalable data solutions, collaborate with cross-functional teams, and contribute to the transformation programme across enterprise and government clients.

Qualifications

• 5+ years of experience in Data Engineering and Database Engineering.
• Strong SQL development and database performance tuning.
• Hands-on experience with AWS data services including Aurora PostgreSQL, Glue, Redshift, QuickSight.
• Experience with Git and CI/CD pipelines, DevOps practices, and Agile methodologies.
• Knowledge of data governance, security, and operational support requirements.

Responsibilities

• Modernise SQL Server databases to AWS-native equivalents.
• Analyse and convert SSIS ETL workflows into AWS Glue jobs and workflows.
• Migrate workloads to Amazon Redshift and rebuild reporting on AWS.
• Design and build scalable data ingestion, transformation, and reporting solutions.
• Develop and optimise database structures, schemas, and performance.
• Implement CI/CD pipelines for data and database deployments.
• Establish data quality, monitoring, and operational support frameworks.
• Collaborate with architects, developers, business stakeholders, and reporting teams.
• Support testing, reconciliation, cutover activities, and post-production support.

Skills

Data engineering

SQL development

Database tuning

Python/PySpark

Git

CI/CD

AWS data services

Tools

Git

CI/CD

Job description

Senior Data Engineer - Cloud Data Modernisation

Contract Opportunity | Sydney, NSW

About the Company

Our client is a well-established technology consulting organisation delivering large-scale digital transformation and cloud modernisation projects for enterprise and government customers across Australia. They are recognised for providing innovative data, cloud, and technology solutions that support critical business outcomes.

About the End Client

The end client is a large organisation undertaking a significant cloud transformation initiative focused on modernising legacy data platforms and establishing scalable, cloud-native data capabilities. This programme will support improved analytics, reporting, operational efficiency, and long-term data strategy.

The Opportunity

An exciting opportunity exists for an experienced Senior Data Engineer to play a key role in modernising a legacy Microsoft SQL Server data platform and transitioning it to AWS-native services. You will be responsible for designing, building, and optimising scalable cloud data solutions while supporting the migration of databases, ETL processes, reporting platforms, and analytical workloads.

Key Responsibilities

• Modernise SQL Server databases to Amazon Aurora PostgreSQL.
• Analyse and convert SSIS ETL workflows into AWS Glue jobs and workflows.
• Migrate analytical workloads and legacy data warehouse capabilities into Amazon Redshift.
• Redevelop reporting and dashboard solutions using AWS-native technologies.
• Design and build scalable data ingestion, transformation, and reporting solutions.
• Develop and optimise database structures, schemas, and performance.
• Implement and maintain CI/CD pipelines for data and database deployments.
• Establish data quality, monitoring, and operational support frameworks.
• Collaborate with architects, developers, business stakeholders, and reporting teams.
• Support testing, reconciliation, cutover activities, and post-production support.

Required Skills & Experience

5+ years' experience in Data Engineering and Database Engineering. Strong SQL development and database performance tuning expertise. Hands-on experience with AWS data services, including:

• Amazon Aurora PostgreSQL
• AWS Glue
• Amazon Redshift
• AWS QuickSight

Experience with AWS DMS and AWS Schema Conversion Tool will be highly regarded. Strong data modelling and database design skills. Proficiency with Python and/or PySpark. Proven experience delivering ETL/ELT pipelines and cloud-native data solutions. Experience working with Git, CI/CD pipelines, DevOps practices, and Agile methodologies. Understanding of data governance, security, and operational support requirements.

What's on Offer

• Opportunity to work on a large-scale cloud data transformation programme.
• Exposure to modern AWS data and analytics technologies.
• Collaborative and high-performing project environment.
• Long-term project potential with significant technical impact.
• Opportunity to shape future-state cloud data architecture and analytics capability.