Senior Data Engineer – Databricks & dbt | Contract

D2i Consulting Pty Ltd; Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

D2i Consulting Pty Ltd is seeking a Senior Data Engineer for a Melbourne client. You will design and deliver data pipelines and models using Databricks, PySpark and dbt, ensuring high-quality, scalable solutions for reporting and analytics.

You will collaborate with business stakeholders and technical teams, implement data quality checks, and optimise performance. Onsite in Melbourne CBD three to four days per week for the initial three-month contract.

Qualifications

• Senior-level data engineering experience with hands-on delivery.
• Strong Databricks (Spark/PySpark) and Delta Lake expertise.
• Proficient in dbt model development, testing and incremental processing.
• Excellent SQL skills and understanding of data warehousing and dimensional modelling.
• Experience building reliable data pipelines and trusted datasets for reporting/analytics.
• Familiar with Git, CI/CD and structured development/deployment practices.
• Confident communicating with business stakeholders and technical teams.

Responsibilities

• Design, build and maintain data pipelines and transformation workflows using Databricks and dbt.
• Develop robust data models, including dimensional models, to support reporting and analytics.
• Integrate data from multiple sources, applying consistent business rules and transformation logic.
• Write efficient SQL and use Python/PySpark to support data processing and engineering tasks.
• Implement data quality checks, automated testing and reconciliation processes.
• Optimise pipeline and query performance, reliability and maintainability.
• Collaborate with business stakeholders and technical teams to translate requirements into practical data solutions.
• Apply sound version control, deployment and documentation practices.
• Investigate and resolve data issues, and provide knowledge transfer to client teams.

Skills

Databricks

dbt

Data modelling

SQL

Python/PySpark

Delta Lake

CI/CD

Git

Tools

Databricks

Job description

D2i Consulting is seeking a Senior Data Engineer with strong hands-on experience in Databricks, dbt and data modelling to deliver reliable, well-structured data solutions for a client engagement. You will work closely with business stakeholders and technical teams to understand requirements, build data pipelines and develop models that support reporting and analytics. This role suits someone who combines strong engineering skills with a practical approach to delivery and clear communication. This is an initial three-month contract with possible extension, subject to project requirements. You will be required onsite at the client's Melbourne CBD office three to four days per week.

Key responsibilities

Design, build and maintain data pipelines and transformation workflows using Databricks and dbt.

Develop robust data models, including dimensional models, to support reporting and analytics.

Integrate data from multiple sources, applying consistent business rules and transformation logic.

Write efficient SQL and use Python/PySpark to support data processing and engineering tasks.

Implement data quality checks, automated testing and reconciliation processes.

Optimise pipeline and query performance, reliability and maintainability.

Collaborate with business stakeholders and technical teams to translate requirements into practical data solutions.

Apply sound version control, deployment and documentation practices.

Investigate and resolve data issues, and provide knowledge transfer to client teams.

About you

Proven experience delivering data engineering solutions at a senior level.

Strong hands-on Databricks experience, including Spark/PySpark and Delta Lake.

Strong dbt capability, including model development, testing, documentation and incremental processing.

Excellent SQL skills and a solid understanding of data warehousing and dimensional modelling.

Experience building reliable pipelines and delivering trusted datasets for reporting and analytics.

Familiarity with Git, CI/CD and structured development and deployment practices.

Confident communicating with both business stakeholders and technical teams.

Able to work independently, take ownership of deliverables and contribute effectively within a project team.

Available to work onsite in Melbourne CBD three to four days per week.

About us

D2i is an Australian-owned Data, Analytics and AI consultancy. We help organisations turn data into business value through data strategy, cloud migration, data integration, reporting and data platform modernisation. Our consultants work closely with clients to deliver practical solutions and build capability within their teams.