Senior Data Engineer (Azure Databricks)

PFD Food Services Pty Ltd; Australia; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Staff discounts

Hybrid work

Onsite parking

Job summary

PFD Food Services Pty Ltd in Australia is seeking a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You will lead data architecture, build scalable pipelines and models, and set foundations for analytics and AI initiatives.

You will collaborate with business stakeholders to deliver trusted data solutions, implement governance and security practices, and provide technical leadership across the team, helping

Qualifications

• Design and deliver enterprise data warehouse and Lakehouse solutions.
• Hands-on with Azure Databricks, PySpark, SQL and Azure Data Factory.
• Build scalable ETL/data pipelines and dimensional data models for analytics.
• Knowledge of data governance, security and data quality frameworks.
• Translate business requirements into practical data solutions.
• Influence technical direction and best practices with stakeholders.

Responsibilities

• Design and develop PFD's enterprise data platform and Lakehouse architecture.
• Build and optimise scalable data pipelines using Azure Databricks, PySpark, SQL and Azure Data Factory.
• Develop dimensional data models that support reporting, analytics and business intelligence.
• Establish data governance, quality standards and security best practices across the data environment.
• Partner with business stakeholders to deliver trusted, accessible and high-quality data solutions.
• Provide technical leadership, mentoring and guidance on modern data engineering practices.

Skills

Enterprise data warehouse

Lakehouse

Azure Databricks

PySpark

SQL

Azure Data Factory

ETL pipelines

Dimensional data models

Data governance

Stakeholder engagement

Tools

Azure Databricks

PySpark

SQL

DBT

Delta Lake

Azure Data Factory

Unity Catalog

Power BI

Job description

• Play a key role in supporting the Australian economy.
• Discounts across food, travel, entertainment and gym memberships, plus onsite staff parking
• Hybrid working environment.

Company

For more than 80 years, PFD Food Services has supplied businesses across Australia with an extensive range of food and related products. As part of Woolworths Group, we continue to invest in our systems, processes and technology to support our customers and future growth.

About this Position

We're looking for a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You'll lead data architecture, build scalable pipelines and models, and help establish the foundations for analytics, reporting and future AI initiatives across the business.

Key Responsibilities

• Design and develop PFD's enterprise data platform and Lakehouse architecture.
• Build and optimise scalable data pipelines using Azure Databricks, PySpark, SQL and Azure Data Factory.
• Develop dimensional data models that support reporting, analytics and business intelligence.
• Establish data governance, quality standards and security best practices across the data environment.
• Partner with business stakeholders to deliver trusted, accessible and high-quality data solutions.
• Provide technical leadership, mentoring and guidance on modern data engineering practices.

What We’re Looking For

To thrive in this role, you will bring:

• Proven experience designing and delivering enterprise data warehouse and Lakehouse solutions.
• Strong hands-on expertise with Azure Databricks, PySpark, SQL and Azure Data Factory.
• Experience building scalable ETL/data pipelines and dimensional data models for analytics and reporting.
• Knowledge of modern data governance, security and data quality frameworks.
• Ability to translate business requirements into practical, high-performing data solutions.
• Strong stakeholder engagement skills and the ability to influence technical direction and best practice.

Tech Stack:

Azure Databricks, PySpark, SQL, DBT, Delta Lake, Azure Data Factory, Unity Catalog and Power BI.

What PFD is Offering the Successful Candidate

We are offering competitive remuneration, superannuation and other staff benefits (such as discounts on staff purchases, discounted accommodation, health insurance and banking).

Culture & Values

• Customer Focus: Know your external and internal customers. Gain and preserve their confidence because we can only be successful if our customers are successful.
• Respect: Treat people at work and in the community as they would like to be treated. Act safely, responsibly, and ethically.
• Passion: Share the passion of making us a successful and dynamic company. Let’s celebrate successes.
• Simplicity: Let’s minimise the complications of doing business so customer services are on time, accurate and reliable. Share ideas to improve our company.
• Leadership: All of us can be leaders in our day to day working lives. Bring out the best in yourself and the people around you. Do what you say you are going to do.

PFD Food Services is committed to being an Equal Employment Opportunity employer.

Applications close Monday, 5 October 2026 at 12:00 pm (AEST). Early applications are encouraged, as hiring managers may begin shortlisting candidates before the closing date. Only shortlisted candidates will be contacted. All applications will be treated confidentially.

Please note:

We do not accept unsolicited CVs from recruitment agencies or third parties. Any CVs sent directly to Line Managers will not be considered, and we will not be responsible for any associated fees or costs.

Keywords:

Azure Databricks, PySpark, SQL, Data Engineer, Data Platform, Data Warehouse, Lakehouse, Azure Data Factory, Delta Lake, Cloud Engineering, ETL, ELT, Architecture.