Senior Data Engineer: Databricks, dbt & Delta Lake (Onsite)

D2i Consulting Pty Ltd; Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

D2i Consulting Pty Ltd is seeking a Senior Data Engineer for a Melbourne client. You will design and deliver data pipelines and models using Databricks, PySpark and dbt, ensuring high-quality, scalable solutions for reporting and analytics.

You will collaborate with business stakeholders and technical teams, implement data quality checks, and optimise performance. Onsite in Melbourne CBD three to four days per week for the initial three-month contract.

Qualifications

• Senior-level data engineering experience with hands-on delivery.
• Strong Databricks (Spark/PySpark) and Delta Lake expertise.
• Proficient in dbt model development, testing and incremental processing.
• Excellent SQL skills and understanding of data warehousing and dimensional modelling.
• Experience building reliable data pipelines and trusted datasets for reporting/analytics.
• Familiar with Git, CI/CD and structured development/deployment practices.
• Confident communicating with business stakeholders and technical teams.

Responsibilities

• Design, build and maintain data pipelines and transformation workflows using Databricks and dbt.
• Develop robust data models, including dimensional models, to support reporting and analytics.
• Integrate data from multiple sources, applying consistent business rules and transformation logic.
• Write efficient SQL and use Python/PySpark to support data processing and engineering tasks.
• Implement data quality checks, automated testing and reconciliation processes.
• Optimise pipeline and query performance, reliability and maintainability.
• Collaborate with business stakeholders and technical teams to translate requirements into practical data solutions.
• Apply sound version control, deployment and documentation practices.
• Investigate and resolve data issues, and provide knowledge transfer to client teams.

Skills

Databricks

dbt

Data modelling

SQL

Python/PySpark

Delta Lake

CI/CD

Git

Tools

Databricks

Job description

D2i Consulting Pty Ltd is seeking a Senior Data Engineer for a Melbourne client. You will design and deliver data pipelines and models using Databricks, PySpark and dbt, ensuring high-quality, scalable solutions for reporting and analytics.

You will collaborate with business stakeholders and technical teams, implement data quality checks, and optimise performance. Onsite in Melbourne CBD three to four days per week for the initial three-month contract.