Senior Data Engineer: Azure Databricks & Lakehouse Leader

PFD Food Services Pty Ltd; Australia; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Staff discounts

Hybrid work

Onsite parking

Job summary

PFD Food Services Pty Ltd in Australia is seeking a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You will lead data architecture, build scalable pipelines and models, and set foundations for analytics and AI initiatives.

You will collaborate with business stakeholders to deliver trusted data solutions, implement governance and security practices, and provide technical leadership across the team, helping

Qualifications

• Design and deliver enterprise data warehouse and Lakehouse solutions.
• Hands-on with Azure Databricks, PySpark, SQL and Azure Data Factory.
• Build scalable ETL/data pipelines and dimensional data models for analytics.
• Knowledge of data governance, security and data quality frameworks.
• Translate business requirements into practical data solutions.
• Influence technical direction and best practices with stakeholders.

Responsibilities

• Design and develop PFD's enterprise data platform and Lakehouse architecture.
• Build and optimise scalable data pipelines using Azure Databricks, PySpark, SQL and Azure Data Factory.
• Develop dimensional data models that support reporting, analytics and business intelligence.
• Establish data governance, quality standards and security best practices across the data environment.
• Partner with business stakeholders to deliver trusted, accessible and high-quality data solutions.
• Provide technical leadership, mentoring and guidance on modern data engineering practices.

Skills

Enterprise data warehouse

Lakehouse

Azure Databricks

PySpark

SQL

Azure Data Factory

ETL pipelines

Dimensional data models

Data governance

Stakeholder engagement

Tools

Azure Databricks

PySpark

SQL

DBT

Delta Lake

Azure Data Factory

Unity Catalog

Power BI

Job description

PFD Food Services Pty Ltd in Australia is seeking a Senior Data Engineer to design and deliver our enterprise data platform using Azure Databricks, PySpark, SQL, DBT and Azure Data Factory. You will lead data architecture, build scalable pipelines and models, and set foundations for analytics and AI initiatives.

You will collaborate with business stakeholders to deliver trusted data solutions, implement governance and security practices, and provide technical leadership across the team, helping