Data Engineer

Xpt Software Australia Pty; City of Melbourne; Presencial; AUD 120.000 - 160.000; Jornada completa

Descripción de la vacante

Xpt Software Australia Pty is seeking a Consultant / Technology Analyst to lead data engineering initiatives. The role emphasizes expert SQL/PLSQL development, Unix scripting, and exposure to modern data platforms including Spark, Hadoop and Kafka.

You will work with AWS-based data solutions and maintain code using Git and Jenkins. The ideal candidate has 6-8 years in data engineering, banking domain exposure, and a strong background in data warehousing, with familiarity in cloud infrastructure

Formación

• Databricks Certified Data Engineer Associate with 6-8 years of experience.
• Expert SQL development experience - minimum 5 years.
• Experience deploying/managing Data and Data Warehouse solutions, particularly in AWS environments.
• Banking domain experience (3-5 years).

Responsabilidades

• SQL script analysis to understand business logic.
• Unix jobs analysis and UNIX Shell scripting.
• Develop data engineering components using Spark, Hadoop, Kafka.
• Build and manage Data and Data Warehouse solutions on AWS.
• Familiar with Git and Jenkins for version control and CI/CD.

Conocimientos

SQL Development

PL/SQL

Python

Scala

Java

Spark

Hadoop

Kafka

AWS Basics

CI/CD

Educación

Databricks Certified Data Engineer Associate

Herramientas

Git

Jenkins

Control-M

Docker

Kubernetes

Terraform

Ansible

CloudFormation

Packer

Descripción del empleo

Role : Consultant / Technology Analyst

Data bricks Certified Data Engineer Associate with 6-8 Yrs of experience

Must have expert SQL Development experience - minimum 5 Yrs of experience

Must be able to perform Analysis:

• SQL Script Analysis to understand the business logic
• Unix jobs analysis

Must have good hands-on experience on writing PL/SQL

Must have good hands-on experience on UNIX Shell scripting

Exposure to Control-M Scheduling.

Exposure to Testing and should be able to efficiently perform Testing.

Should have experience on Git and Jenkins.

Banking Domain experience (3-5 years)

Experience deploying/managing Data and Data Warehouse solutions

Experience in understanding and developing data systems in

• Data Engineering technologies (e.g. Spark, Hadoop, Kafka)
• Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)
• Comfortable writing code in either Python, Scala or Java
• Good AWS fundamentals knowledge
• Understanding of Solution Development life cycles
• Knowledge on cloud technologies, ideally AWS. Have worked in a data operations position for a large Enterprise.
• Working knowledge in Infrastructure as code frameworks, Ansible/Terraform/ Cloud formation/Docker/ECS/Kubernetes/Packer