Quantexa Data Engineer

Nixil; Sydney; Híbrido; AUD 90.000 - 130.000; Tempo integral

Resumo da vaga

Nixil Pty is seeking an experienced Quantexa Data Engineer for a 6–12 month contract with hybrid work locations in Melbourne, Sydney, or Canberra. You will design and optimise data pipelines, implement entity resolution and governance, and collaborate with architects and analysts on risk and compliance data solutions.

The role requires hands-on Quantexa implementation experience, strong Scala and Spark skills, and advanced SQL capabilities to deliver production-grade data pipelines in a

Qualificações

• Australian Government baseline, NV1 or NV2 security clearance or eligibility to obtain one, particularly for Canberra-based opportunities.
• Only open to Australian Citizens.
• Proven hands-on Quantexa implementation experience as a Data Engineer or Developer, not just consumption of outputs.
• Strong Scala and Apache Spark experience in large-scale distributed data processing.
• Advanced SQL skills for data querying, transformation and troubleshooting.
• Solid experience developing production-grade data pipelines.
• Strong understanding of data modelling, mapping, transformation and integration across multiple source systems.
• Experience with entity resolution, record matching, deduplication and entity linking.
• Proven experience delivering enterprise data solutions into production.
• Strong troubleshooting, analytical, communication and stakeholder engagement skills.

Responsabilidades

• Design, develop and maintain data pipelines to ingest, transform and integrate data from multiple internal and external sources.
• Configure and support Quantexa data models, entity resolution, record matching and network generation.
• Develop scalable data processing solutions using Scala, Apache Spark and SQL.
• Perform data cleansing, standardisation, validation and reconciliation across complex, high-volume datasets.
• Optimise data pipelines for performance, scalability and reliability.
• Troubleshoot data quality issues, pipeline failures and integration challenges.
• Implement data quality, lineage, governance and access controls.
• Support testing, production deployments, release management and ongoing platform maintenance.
• Collaborate with solution architects, business analysts, data specialists and governance teams.

Conhecimentos

Quantexa implementations

Scala

Apache Spark

SQL

Data pipelines

Entity resolution

Record matching

Network generation

Data modelling

Governance

Ferramentas

AWS

Azure

GCP

Elasticsearch

Git

CI/CD

Descrição da vaga

• Contract: 6–12 months, with potential extensions (subject to confirmation).
• Locations: Melbourne, Sydney or Canberra.
• Work arrangement: Hybrid.

Join a global IT services and consulting organisation delivering enterprise-scale data and decision intelligence solutions.

We are seeking an experienced Quantexa Data Engineer with strong hands-on experience in Quantexa implementations, Scala, Apache Spark and SQL to design, develop and optimise enterprise data pipelines.

This is an opportunity to contribute to a major data and decision intelligence programme, integrating complex datasets, enabling entity resolution and delivering reliable, high-performance data solutions that support risk, compliance and business decision-making.

Key Responsibilities

• Design, develop and maintain data pipelines to ingest, transform and integrate data from multiple internal and external sources.
• Configure and support Quantexa data models, entity resolution, record matching and network generation.
• Develop scalable data processing solutions using Scala, Apache Spark and SQL.
• Perform data cleansing, standardisation, validation and reconciliation across complex, high-volume datasets.
• Optimise data pipelines for performance, scalability and reliability.
• Troubleshoot data quality issues, pipeline failures and integration challenges.
• Implement data quality, lineage, governance and access controls.
• Support testing, production deployments, release management and ongoing platform maintenance.
• Collaborate with solution architects, business analysts, data specialists and governance teams.

Essential Skills & Experience

• Australian Government baseline, NV1 or NV2 security clearance or eligibility to obtain one, particularly for Canberra-based opportunities.
• ONLY open to Australian Citizens.
• Proven hands-on Quantexa implementation experience as a Data Engineer or Developer, rather than solely consuming Quantexa outputs.
• Strong Scala and Apache Spark experience in large-scale distributed data processing.
• Advanced SQL skills for data querying, transformation and troubleshooting.
• Solid commercial experience developing and maintaining production-grade data pipelines.
• Strong understanding of data modelling, mapping, transformation and integration across multiple source systems.
• Experience with entity resolution, record matching, deduplication and entity linking.
• Proven experience delivering enterprise data solutions into production.
• Strong troubleshooting, analytical, communication and stakeholder engagement skills.

Highly Desirable

• Quantexa certification or experience delivering solutions through a Quantexa partner.
• Experience in financial services, financial crime, fraud, AML, risk or compliance.
• Knowledge of network analytics and graph-based data solutions.
• Experience with AWS, Azure or GCP, Elasticsearch, Git and CI/CD pipelines.
• Understanding of data governance, lineage, provenance and data quality frameworks.
• Experience working in government or regulated enterprise environments.