Senior Data Engineer- Australian Only

The HR Ally; Canberra; Remote; AUD 120,000 - 170,000; Full time

Job summary

The HR Ally is seeking an experienced Senior Data Engineer to design, build and maintain enterprise data products supporting migration of business data from legacy systems to SAP ERP. You will contribute to data warehousing, ETL/ELT pipelines and large-scale data migration in a remote-capable environment.

The ideal candidate brings 5+ years in data engineering, strong SQL and Python skills, and experience with data warehousing, 3NF/Star Schema designs and modernisation projects.

Qualifications

• 5+ years of dedicated Data Engineering experience.
• Strong SQL development, optimisation and data modelling.
• Experience with 3NF and Star Schema design.
• Legacy data warehouse modernisation or large-scale data migration.
• Python scripting and data transformation.
• ETL/ELT pipelines, Data DevOps and data quality controls.
• Data Mart design, development and testing.
• Agile/Scrum experience.

Responsibilities

• Design and develop enterprise data assets from raw to conformed layers.
• Build and optimise SQL-based data pipelines and integration processes.
• Support legacy data warehouse modernisation and large-scale data migration.
• Develop data transformation solutions using Python.
• Implement data quality controls, validation and verification.
• Design, build and test data marts.
• Improve data ingestion and integration patterns.
• Collaborate with technical teams in an Agile environment.

Skills

SQL development

Python scripting

Data modelling

ETL/ELT pipelines

Agile/Scrum

Data warehousing

Data quality controls

3NF/Star Schema

Large-scale data migration

Data DevOps

Tools

SAP

Cloudera

Databricks

Hive

Impala

Spark

Iceberg

Ozone

Job description

Senior Data Engineer

• Location: Canberra, ACT
• Work Arrangement: Remote opportunities may be considered subject to project requirements and applicable conditions.
• Eligibility: Australian Citizens Only

About the Role

We are seeking an experienced Senior Data Engineer to design, build and maintain enterprise data products supporting the migration of business data from legacy systems to SAP ERP.

The ideal candidate will have strong expertise in SQL, Python, data warehousing, ETL/ELT pipelines and large-scale data migration.

Key Responsibilities

• Design and develop enterprise data assets from raw to conformed layers.
• Build and optimise SQL-based data pipelines and integration processes.
• Support legacy data warehouse modernisation and large-scale data migration.
• Develop data transformation solutions using Python.
• Implement data quality controls, validation and verification.
• Design, build and test data marts.
• Improve data ingestion and integration patterns.
• Collaborate with technical teams in an Agile environment.

Essential Skills & Experience

• Minimum 5 years of dedicated Data Engineering experience.
• Strong SQL development, optimisation and data modelling.
• Experience with 3NF and Star Schema design.
• Legacy data warehouse modernisation or large-scale data migration.
• Python scripting and data transformation.
• ETL/ELT pipelines, Data DevOps and data quality controls.
• Data Mart design, development and testing.
• Agile/Scrum experience.

Desirable Skills

• Data Vault 2.0 and Data Mesh architecture.
• SAP Logistics experience.
• Experience handling sensitive data (SECRET, PI and PII).
• Cloudera (Hive, Impala, Ozone, Iceberg, Spark).
• Databricks.