Senior Data Engineer - Banking, Cloud & Spark Expert

Xpt Software Australia Pty; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

Xpt Software Australia Pty is seeking a Consultant / Technology Analyst to lead data engineering initiatives. The role emphasizes expert SQL/PLSQL development, Unix scripting, and exposure to modern data platforms including Spark, Hadoop and Kafka.

You will work with AWS-based data solutions and maintain code using Git and Jenkins. The ideal candidate has 6-8 years in data engineering, banking domain exposure, and a strong background in data warehousing, with familiarity in cloud infrastructure

Qualifications

• Databricks Certified Data Engineer Associate with 6-8 years of experience.
• Expert SQL development experience - minimum 5 years.
• Experience deploying/managing Data and Data Warehouse solutions, particularly in AWS environments.
• Banking domain experience (3-5 years).

Responsibilities

• SQL script analysis to understand business logic.
• Unix jobs analysis and UNIX Shell scripting.
• Develop data engineering components using Spark, Hadoop, Kafka.
• Build and manage Data and Data Warehouse solutions on AWS.
• Familiar with Git and Jenkins for version control and CI/CD.

Skills

SQL Development

PL/SQL

Python

Scala

Java

Spark

Hadoop

Kafka

AWS Basics

CI/CD

Education

Databricks Certified Data Engineer Associate

Tools

Git

Jenkins

Control-M

Docker

Kubernetes

Terraform

Ansible

CloudFormation

Packer

Job description

Xpt Software Australia Pty is seeking a Consultant / Technology Analyst to lead data engineering initiatives. The role emphasizes expert SQL/PLSQL development, Unix scripting, and exposure to modern data platforms including Spark, Hadoop and Kafka.

You will work with AWS-based data solutions and maintain code using Git and Jenkins. The ideal candidate has 6-8 years in data engineering, banking domain exposure, and a strong background in data warehousing, with familiarity in cloud infrastructure