Databricks Data Engineer — AI-Driven Lakehouse Specialist

Deloitte NZ; Auckland; On-site; NZD 120,000 - 180,000; Full time

Benefits offered by this job

Flexible work arrangements

Subsidised professional qualifications

Subsidised health insurance

Income protection insurance

22 days annual leave

Social events & wellness focus

Sustainability focus

Job summary

Deloitte NZ is seeking an experienced Databricks Data Engineer in Auckland to design, build, and maintain scalable data and AI solutions. You will work across ingestion, transformation, modelling, and production support, leveraging Lakehouse architectures and AI-enabled tooling.

Join a team delivering data platforms at enterprise scale, collaborating with data scientists, engineers, and stakeholders to accelerate data-driven outcomes with security and governance at the forefront.

Qualifications

• Strong hands-on experience with Databricks and Lakehouse architectures.
• Solid understanding of data modelling, warehousing, and distributed processing.
• Experience designing batch and/or streaming data pipelines.
• Familiarity with orchestration tools such as Lakeflow Jobs, Azure Data Factory, and Airflow.
• Knowledge of cloud data services on Azure and/or AWS; Git, CI/CD modern practices.

Responsibilities

• Design, develop, and maintain scalable data and AI solutions on Databricks.
• Build robust data ingestion, ELT/ETL, and data processing pipelines.
• Develop reusable transformations via Lakeflow Declarative Pipelines.
• Design Lakehouse architectures and curated data models for analytics and ML.
• Integrate Databricks with cloud platforms, APIs, databases, and streaming systems.
• Implement CI/CD pipelines and modern DevOps practices for Databricks deployments.
• Orchestrate workloads with Lakeflow Jobs, Azure Data Factory, Airflow, or similar tools.
• Ensure security, governance, data quality, lineage, and monitoring controls.

Skills

Databricks

Lakehouse architectures

Data engineering concepts

Data pipelines

Python

CI/CD

Git

Cloud platforms (Azure/AWS)

IaC (Terraform)

Security & data governance

AI/MLOps awareness

Tools

Databricks

Lakeflow

Azure Data Factory

Airflow

Terraform

Git

Job description

Deloitte NZ is seeking an experienced Databricks Data Engineer in Auckland to design, build, and maintain scalable data and AI solutions. You will work across ingestion, transformation, modelling, and production support, leveraging Lakehouse architectures and AI-enabled tooling.

Join a team delivering data platforms at enterprise scale, collaborating with data scientists, engineers, and stakeholders to accelerate data-driven outcomes with security and governance at the forefront.