Senior Data Engineer: Pipelines & Data Quality

XPT Software Australia Pty Ltd; Australia; Remote; AUD 90,000 - 130,000; Full time

Job summary

XPT Software Australia Pty Ltd is seeking a Mid/Senior Data Engineer or Analyst to design and maintain data pipelines across multiple Australian cities. You will work on profiling, cleansing, transformation, and migration tasks, ensuring high data quality and accurate reconciliations for data-heavy deliverables.

Ideal candidates bring data engineering experience on modern platforms, strong SQL and Python or Spark skills, and the ability to provide masked test data.

Qualifications

• Must have data engineering on a modern platform.
• Proficient in SQL and Python or Spark.
• Experience with data quality checks and reconciliation.

Responsibilities

• Build version-controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target data (counts, control totals, field comparisons).
• Provide masked test data for non-production environments.
• Document pipelines and collaborate with ASIC data staff.

Skills

SQL

Python

Spark

Data quality

Data reconciliation

Tools

Databricks

Mainframe data extraction

Informix

Job description

XPT Software Australia Pty Ltd is seeking a Mid/Senior Data Engineer or Analyst to design and maintain data pipelines across multiple Australian cities. You will work on profiling, cleansing, transformation, and migration tasks, ensuring high data quality and accurate reconciliations for data-heavy deliverables.

Ideal candidates bring data engineering experience on modern platforms, strong SQL and Python or Spark skills, and the ability to provide masked test data.