Senior Data Engineer

Allied Credit Pty; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Work-life balance - hybrid working

Wellness day

Volunteer Day

Discount offers

Learning environment

Parental leave

Job summary

Allied Credit is expanding its data capabilities. As a Senior Data Engineer, you will design and evolve our modern data platform using Microsoft Fabric, building scalable data solutions and data pipelines.

You will partner with stakeholders across technology and the business to deliver reliable, secure data products, mentor teammates and drive DevOps and CI/CD practices.

This hybrid role offers work-life balance and opportunities to influence data strategy within a growing vehicle finance firm.

Qualifications

• Proven experience delivering enterprise-scale data platforms.
• Strong hands-on with Microsoft Fabric, including OneLake, Lakehouse, Fabric Warehouse, Pipelines.
• Advanced skills in PySpark, Python and SQL for scalable data solutions.
• Experience designing ETL/ELT pipelines and data models across sources.
• Experience with Delta Lake and data quality at scale.
• Knowledge of Azure DevOps, Git and CI/CD practices.
• Excellent communication and stakeholder engagement.
• Proactive, self-driven in Agile environments; mentoring others.

Responsibilities

• Design, build and optimise scalable data solutions using Microsoft Fabric and modern cloud data technologies.
• Develop data pipelines, integration frameworks and data models that support enterprise analytics and reporting.
• Lead the migration and modernisation of legacy data platforms into a modern cloud-based ecosystem.
• Own the full delivery lifecycle from solution design through deployment, support and continuous improvement.
• Drive performance, reliability, security and governance across the data platform.
• Champion DevOps, automation and best-practice engineering standards.
• Collaborate with business and technical stakeholders to deliver high-impact data solutions.
• Mentor team members and contribute to the growth of a high-performing data engineering capability.

Skills

PySpark

Python

SQL

Data modelling

ETL/ELT pipelines

Azure DevOps

CI/CD

Stakeholder engagement

Leadership / mentoring

Education

Tertiary qualification or equivalent

Tools

Microsoft Fabric

Delta Lake

Azure DevOps

Git

CI/CD

Power BI

Job description

• Our data team is growing & we need an MS data specialist.
• Join an ambitious firm which is growing, evolving & increasing its headcount.
• Allied Credit has a hybrid work environment; we understand the value of a work-life balance.

Allied Credit is a leading vehicle finance firm with strategic alliances with global car, marine and motorcycle brands. Offering white label, joint venture and floorplan finance, our proprietary software provides a seamless, convenient and customer-focused finance service to consumers and businesses.

As a Senior Data Engineer, you'll play a key role in shaping and evolving our modern data platform using Microsoft Fabric. You'll design and deliver scalable, enterprise-grade data solutions, transforming complex data into trusted insights that drive business decisions. The role requires initiative, sound judgement, flexibility and strong communication.

You'll take ownership of projects from design through to deployment and ongoing optimisation, building robust data pipelines, models and frameworks that support a growing business. Working closely with stakeholders across technology and the wider organisation, you'll help modernise our data landscape while ensuring reliability, performance, security and governance remain at the forefront.

Beyond hands-on engineering, you'll provide technical leadership, contribute to architecture and best practices, mentor team members and champion continuous improvement across our data environment. You'll also help drive automation, operational excellence and the adoption of modern data engineering practices.

This is an opportunity to work with leading technologies, influence strategic data initiatives and make a genuine impact on how data is leveraged across the organisation.

Key Responsibilities

• Design, build and optimise scalable data solutions using Microsoft Fabric and modern cloud data technologies.
• Develop data pipelines, integration frameworks and data models that support enterprise analytics and reporting.
• Lead the migration and modernisation of legacy data platforms into a modern cloud-based ecosystem.
• Own the full delivery lifecycle from solution design through deployment, support and continuous improvement.
• Drive performance, reliability, security and governance across the data platform.
• Champion DevOps, automation and best-practice engineering standards.
• Collaborate with business and technical stakeholders to deliver high-impact data solutions.
• Mentor team members and contribute to the growth of a high-performing data engineering capability.

Your background

• Proven experience as a Data Engineer delivering enterprise-scale data platforms and solutions.
• Strong hands-on expertise with Microsoft Fabric, including OneLake, Lakehouse, Fabric Warehouse, Pipelines and modern data warehousing principles.
• Advanced skills in PySpark, Python and SQL, with experience building scalable, high-performance data solutions.
• Solid experience designing ETL/ELT pipelines, data models and ingestion frameworks across multiple data sources.
• Experience with Delta Lake, data optimisation, data quality and large-scale data processing.
• Strong knowledge of Azure DevOps, Git and CI/CD practices.
• Excellent communication, stakeholder engagement and problem-solving skills, with the ability to influence technical and non-technical audiences.
• A proactive, self-driven approach, with experience working in Agile environments, mentoring others and supporting production platforms.
• Relevant tertiary qualification or equivalent industry experience.

Nice to Have

• Experience with Microsoft Purview and data governance frameworks.
• Exposure to Azure services including Storage, Key Vault, Functions and Logic Apps.
• Experience with Power BI, semantic models and DAX.
• Knowledge of Azure Data Factory, Azure Synapse, Databricks, Kafka or event streaming technologies.
• Exposure to AI, machine learning or advanced analytics workloads within Microsoft Fabric.
• Microsoft, Azure, Fabric, Agile or DevOps certifications.
• Understanding of data governance, lineage, security, privacy and access controls; hands-on Microsoft Purview experience is strongly desirable.
• Experience with Azure Storage, Azure Key Vault, Azure Functions and Azure Logic Apps is strongly desirable.
• Experience with Power BI, semantic models and DAX is strongly desirable.
• Experience with Azure Data Factory, Azure Synapse Analytics, event streaming, Kafka or Databricks is advantageous.
• Exposure to machine learning integration and AI workloads within Microsoft Fabric is advantageous.

Why work for Allied Credit?

• Work-life balance - hybrid working arrangements allow a balance of working from home and the office, and we are always willing to discuss flexible working options.
• Wellness day to take a day off for some R&R around your birthday and a Volunteer Day to support your community.
• Discount offers on selected retailers, car loans and novated leasing options.
• A learning environment where we take your development and career aspirations seriously.
• 16 weeks of paid parental leave along with Salary Continuance Insurance.

We want individuals who will buy into and thrive with Allied Credit’s Values of Customer Focus, Adaptability, Risk Confidence, Integrity and Teamwork.

Allied Credit pledges to treat all candidates with the utmost respect and professionalism throughout the recruitment process. We promise to conduct a fair, transparent, and inclusive hiring process, ensuring that all candidates are evaluated based on their skills, experience, and potential, regardless of race, gender, age, disability, sexual orientation or any other irrelevant characteristic.