Senior Data Engineer - Azure Databricks Lakehouse (Remote)

PFD Food Services; City of Brisbane; Remote; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Staff discounts (food, travel,娱乐, gym)

Onsite staff parking

Health insurance

Superannuation / banking benefits

Job summary

PFD Food Services in Australia is seeking a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You'll lead data architecture, build scalable pipelines and models, and help establish analytics foundations across the business.

This role offers opportunities to influence AI initiatives, collaborate with stakeholders, and implement governance and security best practices in a fast-growing team.

Qualifications

• Proven experience designing and delivering enterprise data warehouse and Lakehouse solutions.
• Strong hands-on expertise with Azure Databricks, PySpark, SQL and Azure Data Factory.
• Experience building scalable ETL/data pipelines and dimensional data models for analytics and reporting.
• Knowledge of modern data governance, security and data quality frameworks.
• Ability to translate business requirements into practical, high-performing data solutions.
• Strong stakeholder engagement skills and the ability to influence technical direction and best practice.

Responsibilities

• Design and develop PFD's enterprise data platform and Lakehouse architecture.
• Build and optimise scalable data pipelines using Azure Databricks, PySpark, SQL and Azure Data Factory.
• Develop dimensional data models that support reporting, analytics and business intelligence.
• Establish data governance, quality standards and security best practices across the data environment.
• Partner with business stakeholders to deliver trusted, accessible and high-quality data solutions.
• Provide technical leadership, mentoring and guidance on modern data engineering practices.

Skills

Azure Databricks

PySpark

SQL

Azure Data Factory

Data modeling

Data governance

Stakeholder engagement

Tools

DBT

Delta Lake

Power BI

Unity Catalog

Job description

PFD Food Services in Australia is seeking a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You'll lead data architecture, build scalable pipelines and models, and help establish analytics foundations across the business.

This role offers opportunities to influence AI initiatives, collaborate with stakeholders, and implement governance and security best practices in a fast-growing team.