Data Engineer - Data Mesh & Legacy Migration Lead

Indigitise; Canberra; On-site; AUD 120,000 - 180,000; Full time

Job summary

Indigitise in Canberra is seeking a seasoned Data Engineer to design and implement data integration pipelines sourcing logistics data from legacy systems.

You will collaborate with Business Analysts, Data Architects and developers to map data structures across logistics, inventory and asset management, and devise data object designs for relational and data mesh environments, supporting Army analytical products.

Qualifications

• Minimum 5 years dedicated data engineering experience across: SQL development including 3NF and STAR schema design.
• Experience migrating legacy data warehouse environments to analytical platforms.
• Datamart design, build and testing.
• SQL code optimisation and refactoring.
• Python scripting and data transformation.
• Experience with Data Vault 2.0 patterns and data mesh structures.
• Experience with logistics systems and SAP context.
• Experience with Defence or related industries such as capability development and delivery.
• Experience with sensitive datasets (PII/PII) and security requirements.
• Experience with large teams on complex analytics projects.
• Familiarity with Cloudera data analytics suite and Databricks.

Responsibilities

• Design and implement data integration pipelines sourcing logistics and sustainment data from legacy applications.
• Collaborate with stakeholders to analyse data structures and develop mappings across logistics, maintenance, inventory, supply chain and asset management.
• Develop data object designs for relational and data mesh environments within the data generation lifecycle for Army analytics.
• Support legacy data warehouse migration to Defence enterprise data mesh architecture.
• Design and develop domain-aligned data products supporting self-service analytics, reporting and decision support.
• Transform landed data into centrally managed warehouse STAR schema and governed data products.
• Support federated governance, data discovery and enterprise-wide data sharing capabilities.
• Apply DevSecOps, CI/CD and pipeline execution; ensure governance, security and information management compliance.

Skills

SQL development

3NF design

STAR schema

Data mesh concepts

Python scripting

Data Vault 2.0

Databricks

Hive/Impala

Data migration

Tools

Cloudera CDV

Hive

Impala

Ozone

Iceberg

Spark

Databricks

Job description

Indigitise in Canberra is seeking a seasoned Data Engineer to design and implement data integration pipelines sourcing logistics data from legacy systems.

You will collaborate with Business Analysts, Data Architects and developers to map data structures across logistics, inventory and asset management, and devise data object designs for relational and data mesh environments, supporting Army analytical products.