Senior Data Engineer: Pipelines, Reconciliation & Quality

Xpt Software Australia Pty Ltd; Brisbane; On-site; AUD 100,000 - 170,000; Full time

Job summary

Xpt Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer or Analyst to deliver data engineering and analysis for data-heavy deliverables. The role reports to the Data Architect and requires building and automating robust data pipelines, ensuring data quality, and reconciling legacy systems with targets.

Brisbane-based, citizens with baseline clearance preferred. The position emphasizes modern data platforms, governance with ASIC data staff collaboration, and hands-on pipeline

Qualifications

• Experience with data pipelines on modern platforms.
• Proficiency in SQL and Python or Spark.
• Experience with data quality and reconciliation.

Responsibilities

• Build version-controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target datasets.
• Provide masked test data for non-production environments.
• Document pipelines and collaborate with ASIC data staff.

Skills

SQL

Python

Spark

Tools

Databricks

Job description

Xpt Software Australia Pty Ltd is seeking a Mid to Senior Data Engineer or Analyst to deliver data engineering and analysis for data-heavy deliverables. The role reports to the Data Architect and requires building and automating robust data pipelines, ensuring data quality, and reconciling legacy systems with targets.

Brisbane-based, citizens with baseline clearance preferred. The position emphasizes modern data platforms, governance with ASIC data staff collaboration, and hands-on pipeline