Data Engineer: Build Scalable Pipelines & Insights (Remote)

Quantexa; City of Melbourne; Remote; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Company bonus

12% Superannuation

20 days annual leave

Job summary

Quantexa Delivery is seeking a data engineer to join a fast-paced team in Melbourne or remotely. You will build end-to-end data pipelines using Spark, Hadoop, and Scala, and deploy Quantexa software across private and public clouds.

You will transform and cleanse high-volume data, enabling clients to tackle fraud, financial crime, data management, risk and customer intelligence. You will collaborate with architects and R&D to share knowledge and raise standards.

Qualifications

• Minimum 18 months in a data engineering role or equivalent.
• Proficiency in Scala, Java, or Python.
• Experience building production level data processing batch systems.
• Experience with Git, Gradle, Nexus, Jenkins, Docker and DevOps tooling.
• Strong technical communication with client environments.
• Knowledge of unit/integration testing (ScalaTest or similar).

Responsibilities

• Write defensive, fault-tolerant production code for data processing systems.
• Configure and deploy Quantexa software using Spark, Hadoop, Scala, Elasticsearch on cloud platforms.
• Be a trusted source of knowledge for clients and translate technical concepts for non-technical audiences.
• Collaborate with solution architects and R&D engineers to promote best practices in big data challenges.

Skills

Scala

Java

Python

Data engineering

DevOps tooling

Tools

Spark

Hadoop

Elasticsearch

Git

Gradle

Nexus

Jenkins

Docker

Job description

Quantexa Delivery is seeking a data engineer to join a fast-paced team in Melbourne or remotely. You will build end-to-end data pipelines using Spark, Hadoop, and Scala, and deploy Quantexa software across private and public clouds.

You will transform and cleanse high-volume data, enabling clients to tackle fraud, financial crime, data management, risk and customer intelligence. You will collaborate with architects and R&D to share knowledge and raise standards.