Data Engineer — Spark, Scala & Quantexa Pipelines (Hybrid)

Nixil Pty; Sydney; Hybrid; AUD 90,000 - 130,000; Full time

Job summary

Nixil Pty is seeking an experienced Quantexa Data Engineer for a 6–12 month contract with hybrid work locations in Melbourne, Sydney, or Canberra. You will design and optimise data pipelines, implement entity resolution and governance, and collaborate with architects and analysts on risk and compliance data solutions.

The role requires hands-on Quantexa implementation experience, strong Scala and Spark skills, and advanced SQL capabilities to deliver production-grade data pipelines in a

Qualifications

• Australian Government baseline, NV1 or NV2 security clearance or eligibility to obtain one, particularly for Canberra-based opportunities.
• Only open to Australian Citizens.
• Proven hands-on Quantexa implementation experience as a Data Engineer or Developer, not just consumption of outputs.
• Strong Scala and Apache Spark experience in large-scale distributed data processing.
• Advanced SQL skills for data querying, transformation and troubleshooting.
• Solid experience developing production-grade data pipelines.
• Strong understanding of data modelling, mapping, transformation and integration across multiple source systems.
• Experience with entity resolution, record matching, deduplication and entity linking.
• Proven experience delivering enterprise data solutions into production.
• Strong troubleshooting, analytical, communication and stakeholder engagement skills.

Responsibilities

• Design, develop and maintain data pipelines to ingest, transform and integrate data from multiple internal and external sources.
• Configure and support Quantexa data models, entity resolution, record matching and network generation.
• Develop scalable data processing solutions using Scala, Apache Spark and SQL.
• Perform data cleansing, standardisation, validation and reconciliation across complex, high-volume datasets.
• Optimise data pipelines for performance, scalability and reliability.
• Troubleshoot data quality issues, pipeline failures and integration challenges.
• Implement data quality, lineage, governance and access controls.
• Support testing, production deployments, release management and ongoing platform maintenance.
• Collaborate with solution architects, business analysts, data specialists and governance teams.

Skills

Quantexa implementations

Scala

Apache Spark

SQL

Data pipelines

Entity resolution

Record matching

Network generation

Data modelling

Governance

Tools

AWS

Azure

GCP

Elasticsearch

Git

CI/CD

Job description

Nixil Pty is seeking an experienced Quantexa Data Engineer for a 6–12 month contract with hybrid work locations in Melbourne, Sydney, or Canberra. You will design and optimise data pipelines, implement entity resolution and governance, and collaborate with architects and analysts on risk and compliance data solutions.

The role requires hands-on Quantexa implementation experience, strong Scala and Spark skills, and advanced SQL capabilities to deliver production-grade data pipelines in a