Databricks Lakehouse Data Engineer

Deloittenz; Christchurch; Hybrid; NZD 120,000 - 180,000; Full time

Job summary

Deloitte in New Zealand (Christchurch) is seeking a Databricks Data Engineer to design, build, and maintain scalable data and AI solutions on Databricks. You will work across ingestion, transformation, modelling, orchestration, deployment, optimisation, and production support while leveraging Lakebase, Unity Catalog, and Databricks Apps.

Collaborate with architects, data scientists, and stakeholders to translate requirements into practical solutions, applying AI-assisted development tools for

Qualifications

• Strong hands-on Databricks experience.
• Experience designing modern Lakehouse architectures.
• Understanding of data engineering, data modelling, data warehousing, and distributed processing.

Responsibilities

• Design, develop, and maintain scalable data and AI solutions on Databricks.
• Build robust data ingestion, ELT/ETL, and data processing pipelines using Databricks.
• Develop high-quality and reusable transformations through Lakeflow Declarative Pipelines.
• Design and implement Lakehouse architectures.
• Build dimensional, curated, and feature-ready data models to support reporting, analytics, ML, and Generative AI use cases.
• Develop and maintain integrations between Databricks and cloud platforms, APIs, databases, files, streaming platforms, and enterprise applications.
• Implement automated CI/CD pipelines and modern DevOps practices for Databricks deployments.
• Develop and orchestrate workloads using Lakeflow Jobs, Azure Data Factory, Airflow, or similar technologies.
• Implement appropriate security, governance, data quality, lineage, and monitoring controls.
• Optimise Databricks workloads for performance, scalability, reliability, and cost efficiency.
• Troubleshoot complex platform, pipeline issues across development and production environments.
• Collaborate with architects, analysts, data scientists, ML engineers, and business stakeholders to translate requirements into practical technical solutions.
• Contribute to engineering standards, reusable frameworks, technical documentation, and continuous improvement initiatives.
• Proactively leverage Genie Code, GitHub Copilot, and other AI-powered development tools across solution design, coding, testing, troubleshooting, code review, and documentation.
• Identify opportunities to use AI and automation to reduce repetitive engineering effort and accelerate the development lifecycle.

Skills

Databricks

Lakehouse

Python

CI/CD

Git

Security

Tools

Databricks

Lakeflow

Azure Data Factory

Airflow

Terraform

Job description

Deloitte in New Zealand (Christchurch) is seeking a Databricks Data Engineer to design, build, and maintain scalable data and AI solutions on Databricks. You will work across ingestion, transformation, modelling, orchestration, deployment, optimisation, and production support while leveraging Lakebase, Unity Catalog, and Databricks Apps.

Collaborate with architects, data scientists, and stakeholders to translate requirements into practical solutions, applying AI-assisted development tools for