Senior Data Engineer/Analyst — Modern Pipelines

XPT Software; Sydney; On-site; AUD 110,000 - 170,000; Full time

Job summary

XPT Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer or Analyst (Citizens with Baseline) to join our data team. You will build and maintain data pipelines, profile, cleanse, transform and migrate data for client projects, ensuring version control and reproducibility.

The role reports to the Data Architect and emphasizes data quality, reconciliation, and providing masked test data for non-production environments.

Qualifications

• Data engineering on a modern platform.
• SQL and Python or Spark; data quality and reconciliation.
• Desirable: Databricks; mainframe or Informix data extraction; registry or financial data.

Responsibilities

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Skills

SQL

Python

Spark

Tools

Databricks

Mainframe

Informix

Job description

XPT Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer or Analyst (Citizens with Baseline) to join our data team. You will build and maintain data pipelines, profile, cleanse, transform and migrate data for client projects, ensuring version control and reproducibility.

The role reports to the Data Architect and emphasizes data quality, reconciliation, and providing masked test data for non-production environments.