Data Engineer: Azure Pipelines, PySpark & Analytics

People First Bank; Sydney; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Paid parental leave

Hybrid working

Employee banking benefits

Discounted insurances

Career development

Training and coaching

Employee assistance program

Volunteering days

Diversity & inclusion

Job summary

People First Bank in Australia is seeking a highly skilled data engineer to join the Data and Insights team. You will help administer and improve the Data and Insight platform, ensuring stability, scalability, and security while building data pipelines for analytics and reporting.

You will develop and enhance in-house PySpark frameworks, mentor junior staff, collaborate with stakeholders, design end-to-end data solutions, and deliver high-quality results on time using Azure DevOps, Git, and

Qualifications

• Extensive experience as a data engineer in a complex data environment.
• Hands-on with Azure Cloud Services.
• Strong SQL, PySpark and Python proficiency.
• Experience with Azure DevOps Git and Azure Pipelines; Power BI and PowerShell skills.

Responsibilities

• Develop and enhance in-house PySpark frameworks for standardized implementations and re-use.
• Mentor and upskill junior team members and the analytics community.
• Liaise with internal and external stakeholders to deliver high-quality data-driven solutions.
• Conduct Exploratory Data Analysis and design end-to-end data engineering solutions.
• Deliver quality solutions on time using testing, documentation, and Azure DevOps services (Git and Pipelines).
• Monitor and support Data and Insights Platform batch operations.

Skills

PySpark

SQL

Python

Power BI

PowerShell

Azure DevOps

Azure Pipelines

Tools

Azure DevOps Git

Azure Pipelines

Job description

People First Bank in Australia is seeking a highly skilled data engineer to join the Data and Insights team. You will help administer and improve the Data and Insight platform, ensuring stability, scalability, and security while building data pipelines for analytics and reporting.

You will develop and enhance in-house PySpark frameworks, mentor junior staff, collaborate with stakeholders, design end-to-end data solutions, and deliver high-quality results on time using Azure DevOps, Git, and