Data Engineer: End-to-End Big Data Pipelines (Remote)

Quantexa Limited; City of Melbourne; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Company bonus

12% Superannuation

20 days annual leave

Private Healthcare

Regular salary benchmarking

Work from Home Equipment

Work from Anywhere policy

Employee referrals

Team social events

Learning & development access

Job summary

Quantexa Limited is hiring a data engineer to join our delivery team in Melbourne. You will integrate and build end-to-end data pipelines using our technology, handling large-scale data for domains like banking, insurance, and government.

You will solve complex data problems, transform and cleanse data, and work with modern tools such as Spark, Hadoop, Elasticsearch, and cloud platforms. A collaborative, problem-solving mindset is essential.

Qualifications

• Minimum 18 months in a data engineering role or equivalent.
• Proficiency in Scala, Java or Python for data engineering tasks.
• Experience building production data processing pipelines and batch systems.
• Knowledge of testing libraries and differentiating unit vs. integration tests.
• Familiarity with Git, Gradle, Nexus and automation/DevOps tooling.

Responsibilities

• Write defensive, fault-tolerant code for production data processing systems.
• Configure and deploy software using Spark, Hadoop, Elasticsearch on cloud platforms.
• Explain technical concepts to non-technical clients and stakeholders.
• Collaborate with solution architects and R&D engineers to promote standards for big data.

Skills

Scala

Java

Python

Big data

DevOps

Tools

Spark

Hadoop

Elasticsearch

Docker

Jenkins

Git

Gradle

Nexus

Job description

Quantexa Limited is hiring a data engineer to join our delivery team in Melbourne. You will integrate and build end-to-end data pipelines using our technology, handling large-scale data for domains like banking, insurance, and government.

You will solve complex data problems, transform and cleanse data, and work with modern tools such as Spark, Hadoop, Elasticsearch, and cloud platforms. A collaborative, problem-solving mindset is essential.