Senior Data Engineer: SQL, Python & Spark Pipelines

Xpt Software Australia Pty Ltd; Traralgon; On-site; AUD 110,000 - 150,000; Full time

Job summary

Xpt Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer/Analyst to join our team in Traralgon, Australia. You will work with data architects to build scalable pipelines for profiling, cleansing and migrating data, ensuring data quality and accurate reconciliation with legacy systems.

The role requires strong SQL and Python or Spark skills, experience on modern data platforms, and the ability to document pipelines while collaborating with ASIC data staff.

Qualifications

• Experience building data pipelines and data integration workflows.
• Strong SQL and Python (or Spark) skills.
• Experience with data quality and reconciliation.

Responsibilities

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Skills

Data engineering

SQL

Python

Spark

Data quality

Data reconciliation

Tools

Databricks

Mainframe data

Job description

Xpt Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer/Analyst to join our team in Traralgon, Australia. You will work with data architects to build scalable pipelines for profiling, cleansing and migrating data, ensuring data quality and accurate reconciliation with legacy systems.

The role requires strong SQL and Python or Spark skills, experience on modern data platforms, and the ability to document pipelines while collaborating with ASIC data staff.