Mid / Senior Data Engineer Or Analyst (Citizens With Baseline)

Xpt Software Australia Pty Ltd; Sydney; On-site; AUD 90,000 - 140,000; Full time

Job summary

Xpt Software Australia Pty Ltd in Melbourne, NSW, Australia is seeking a Mid to Senior Data Engineer or Analyst to build and maintain data pipelines on a modern platform. You will work with SQL and Python or Spark to ensure data quality and reliable reconciliation across systems, reporting to the Data Architect.

Responsibilities include version-controlled pipelines, automated reconciliation, masked non-production data, and documenting pipelines while collaborating with ASIC data staff.

Qualifications

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Responsibilities

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Skills

SQL

Python

Spark

Data quality

Reconciliation

Tools

Databricks

Mainframe

Informix

Job description

Purpose: provide data engineering and analysis skills to data heavy deliverables.

Seniority: Mid to senior.

Reports to: Data Architect.

Responsibilities

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Essential

data engineering on a modern platform; SQL and Python or Spark; data quality and reconciliation.

Desirable

Databricks; mainframe or Informix data extraction; registry or financial data.

Requirements

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Mid / Senior Data Engineer or Analyst (Citizens with Baseline) Melbourne, NSW, au