Mid/Senior Data Engineer: Pipelines & Data Quality

Xpt Software Australia Pty Ltd; Sydney; Presencial; AUD 90.000 - 140.000; Tempo integral

Resumo da vaga

Xpt Software Australia Pty Ltd in Melbourne, NSW, Australia is seeking a Mid to Senior Data Engineer or Analyst to build and maintain data pipelines on a modern platform. You will work with SQL and Python or Spark to ensure data quality and reliable reconciliation across systems, reporting to the Data Architect.

Responsibilities include version-controlled pipelines, automated reconciliation, masked non-production data, and documenting pipelines while collaborating with ASIC data staff.

Qualificações

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Responsabilidades

• Build version controlled pipelines for profiling, cleansing, transformation and migration.
• Automate reconciliation between legacy and target (counts, control totals, field comparisons).
• Provide masked test data for non production environments.
• Document pipelines and pair with ASIC data staff.

Conhecimentos

SQL

Python

Spark

Data quality

Reconciliation

Ferramentas

Databricks

Mainframe

Informix

Descrição da vaga

Xpt Software Australia Pty Ltd in Melbourne, NSW, Australia is seeking a Mid to Senior Data Engineer or Analyst to build and maintain data pipelines on a modern platform. You will work with SQL and Python or Spark to ensure data quality and reliable reconciliation across systems, reporting to the Data Architect.

Responsibilities include version-controlled pipelines, automated reconciliation, masked non-production data, and documenting pipelines while collaborating with ASIC data staff.