Databricks Lakehouse Engineer - AI-Driven Data Pipelines

Deloittenz; Wellington; On-site; NZD 120,000 - 180,000; Full time

Job summary

Deloitte New Zealand is seeking a Databricks Data Engineer to design, build, and maintain scalable data and AI solutions using Databricks. You will work across the engineering lifecycle, from ingestion and transformation to modelling, orchestration, deployment, and production support, leveraging Lakebase, Unity Catalog, and Databricks Apps.

Your AI-enabled mindset will drive use of Genie Code, GitHub Copilot, and other tools to accelerate delivery while upholding security and quality standards.

Qualifications

• Strong hands-on Databricks experience and Lakehouse architecture
• Proficient in Python for data engineering workflows
• Experience with CI/CD and modern software engineering practices
• Git-based collaboration and version control are essential
• Familiarity with Azure and/or AWS cloud services

Responsibilities

• Design, develop, and maintain scalable data and AI solutions on Databricks.
• Build robust data ingestion, ELT/ETL, and data processing pipelines.
• Develop transformations with Lakeflow Declarative Pipelines.
• Design Lakehouse architectures and data models for analytics and ML.
• Implement automated CI/CD pipelines and DevOps practices for Databricks deployments.
• Collaborate with architects, data scientists, and stakeholders to deliver practical solutions.

Skills

Databricks expertise

Python

CI/CD practices

Git workflow

Cloud platforms (Azure/AWS)

Tools

Databricks

Lakeflow

Azure Data Factory

Airflow

Terraform

Job description

Deloitte New Zealand is seeking a Databricks Data Engineer to design, build, and maintain scalable data and AI solutions using Databricks. You will work across the engineering lifecycle, from ingestion and transformation to modelling, orchestration, deployment, and production support, leveraging Lakebase, Unity Catalog, and Databricks Apps.

Your AI-enabled mindset will drive use of Genie Code, GitHub Copilot, and other tools to accelerate delivery while upholding security and quality standards.