Technology Analyst (Databricks Certified Data Engineer)

Xpt Software Australia Pty; City of Melbourne; On-site; AUD 140,000 - 180,000; Full time

Job summary

Xpt Software Australia Pty is seeking a Databricks Certified Data Engineer Associate with 8–10 years of experience to join our data engineering team in Melbourne. The role requires expert SQL development, data analysis, and hands-on Unix scripting to build and optimize data systems.

You'll work on data and data warehouse solutions using Spark, Hadoop and Kafka, with proficiency in Python/Scala/Java and strong AWS fundamentals. Familiarity with Control-M, testing, and Git/Jenkins is preferred.

Qualifications

• Databricks Certified Data Engineer Associate with 8–10 years of experience.
• Expert SQL development with at least 5 years of experience.
• Strong data analysis and business logic understanding.
• Hands-on UNIX shell scripting and PL/SQL experience.
• Experience with Control-M scheduling and testing.
• Experience with Git and Jenkins.
• Banking domain experience (3–5 years).
• Experience deploying/managing data and data warehouse solutions.
• Knowledge of Spark, Hadoop, Kafka.
• Proficient in Python, Scala or Java and AWS fundamentals.
• Understanding of SDLC.

Responsibilities

• Collaborative, persuasive, self-motivated and hands-on approach.
• Work within a high-performing, diverse team with a culture of innovation.
• Drive change across the project and deliver data solutions.

Skills

Data analysis

SQL development

Unix shell scripting

Git

Jenkins

Python/Scala/Java coding

AWS fundamentals

SDLC understanding

Education

Databricks Certified Data Engineer Associate

Tools

Spark

Hadoop

Kafka

Control-M

AWS

Job description

Job Description

Key accountabilities of the role

Databricks Certified Data Engineer Associate with 8-10 Yrs of experience

Must have expert SQL Development experience - minimum 5 Yrs of experience

Must be able to perform Analysis:

• Data Analysis
• SQL Script Analysis to understand the business logic
• Unix jobs analysis

Must have good hands-on experience on writing PL/SQL

Must have good hands-on experience on UNIX Shell scripting

Exposure to Control-M Scheduling.

Exposure to Testing and should be able to efficientlyperform Testing.

Should have experience on Git and Jenkins.

Banking Domain experience (3-5 years)

Experience deploying/managing Data and Data Warehouse solutions.

Experience in understanding and developing data systems in

• Data Engineering technologies (e.g. Spark, Hadoop, Kafka)
• Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)
• Comfortable writing code in either Python, Scala, or Java
• Good AWS fundamentals knowledge

Understanding of Solution Development life cycles

Key Challenges of the role :

• Knowledge on cloud technologies, ideally AWS. Have worked in a data operations position for a large Enterprise.
• Working knowledge in Infrastructure as code frameworks, Ansible/Terraform/ Cloud formation/Docker/ECS/Kubernetes/Packer

Responsibilities

• Collaborative & Persuasive, Self-motivated, Research Oriented, Hands-on, Committed, Always-on learner.
• High performing and diverse team with an unrivalled culture of innovation
• Opportunity to drive change across the project