Data Engineer, Databricks

Cuscal Limited; Sydney; On-site; AUD 120,000 - 190,000; Full time

Benefits offered by this job

Recognition and growth

Wellbeing focus

Inhouse Barista

Job summary

Cuscal Limited is seeking a Data Engineer to design, build and support data products using the data lake and analytics systems. You will work in a scrum team with client interaction across product, engineering and analytics teams.

Ideal candidates have 5+ years in data engineering, strong Databricks SQL analytics and PowerBI experience, and a background in payments or financial services. The role involves on-call responsibilities and alignment with enterprise standards.

Qualifications

• 5+ years in Data Engineering, ideally Payments.
• Strong Databricks, Datalake and Data Warehousing knowledge.
• Proficient in Python and SQL.
• Experience with Oracle and/or SQL databases.
• Experience with Databricks tuning and analytics tools.
• PCI-DSS environment experience and SDLC awareness.

Responsibilities

• Participate in discovery workshops with clients and internal teams.
• Design data solutions with the product owner to address pain points.
• ETL development using Cuscal data sources and Big Data tech.
• Create and maintain efficient data pipelines.
• Manage ETL workflow scheduling and reliability.
• Develop analytic solutions using Databricks SQL Analytics and PowerBI.
• Handle large, complex datasets and data relationships.
• Monitor system availability and implement changes.
• Track trends and embed risk management in data practices.
• Support deployments in line with enterprise architecture.
• Respond to incidents and manage on-call availability.

Skills

Databricks

Datalake

Data Warehousing

Python

SQL

PCI-DSS experience

PowerBI

Terraform

PowerShell

Analytics

Tools

Databricks

Databricks SQL

Oracle

SQL Databases

PowerBI

Terraform

PowerShell

Job description

At Cuscal, our Commercial and Business teams are the backbone of our organisation. From supporting clients and driving growth to ensuring compliance, managing finances, and fostering a positive workplace culture, our people play a vital role in achieving our commercial objectives while staying true to our values.

If you’re looking for a role where your skills and ideas make a real impact, join us to help shape the future of payments in Australia.

Job Description

The Data Engineer is responsible for the design, development and support of the Data Products Cuscal creates for both internal and client facing use cases by primarily working on sourcing, transforming, securing and monitoring data for the creation of products using Cuscal’s data lake and analytics systems. The data engineer will be part of a scrum team and actively engages in both discovery and delivery activities and as such will have direct interaction with our clients, specifically their product, engineering and analytics personnel. The data engineer will work in partnership with our Data Practice to deliver solutions that meet our organisational standards and best practices

To suceed in this role you will:

• Participate in discovery workshops to understand internal and client problems
• Work with the product owner to design solutions that address identified pain points
• Employ Cuscal infrastructure for extraction, transformation, and loading (ETL) of data from a wide variety of data sources using ‘Big Data’ technologies
• Create and maintain Data pipelines in an efficient manner
• Maintain, troubleshoot, and improve the workflow and job scheduling of ETL processes
• Assist in the design & development of analytic solutions. Mostly in Databricks SQL Analytics &/or PowerBI
• Manage and process complex, large data for analysis (e.g. hierarchies of datasets, inter-relationships, partitions, views, etc.)
• Maintaining a high level of system availability, system monitoring, fault diagnosis and change implementation and review
• Work with our Data Practice to support the tracking, analysis and review of trends in commonly occurring support issues and then embed identified risk management strategies.
• Maintain and support applications in line with approved standards and adjust in alignment with Enterprise Architecture
• Respond to incidents and manage systems availability (change, incident and problem management)
• Take part in 24 x 7 on call support roster, as required.

Qualifications

You'll stand out if you have:

• 5+ years in Data Engineering, ideally in Payments
• Strong knowledge in Databricks, Datalake and Data Warehousing techniques.
• Experience in one or more programming languages, Python preferred
• Experience with Oracle and/or SQL databases and writing SQL.
• Knowledge and understanding of Databricks tuning and functions
• Experience in Analytics; Databricks SQL Analytics &/or PowerBI preferred.
• Experience in scripting & Infrastructure as Code; eg: PowerShell, Terraform
• Experience in the financial services or payments sector
• Experience working within PCI-DSS compliant environment
• Knowledge of project delivery techniques and methodologies
• Knowledge of Software Delivery Lifecycle techniques and methodologies
• Knowledge of Secure Development lifecycle (SDLC)
• Sound knowledge of ITIL standards.

Additional Information

Why Cuscal?

At Cuscal,you’llexperience interesting workthat’stransforming. You get the security of an established organisation and the energy of a company committed to innovation. For 60 years,we’veset the standard in payments, and nowwe’repreparing to redefine it for the future.

You’llalso enjoy a range of benefits, including:

• Recognition and growth: Celebrate achievements through IGNITE and grow with tailored development opportunities
• Wellbeing focus: We support your physical, mentaland financial health with holistic initiatives and access to discounts via Cuscal Advantage
• Inhouse Barista: for whenever you feel like your favourite hot beverage

Cuscal is an equal opportunity employer committed to creating a diverse, inclusive and barrier-free workplace. We welcome applications from Aboriginal and Torres Strait Islander peoples, people living with disability, LGBTQIA+ communities and individuals from culturally diverse backgrounds.