Databricks and AI Engineer

BI & DW Australia; Sydney; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Databricks apprenticeship or project-?

Job summary

BI & DW Australia is seeking a Databricks engineer with strong AI skills to join our data and analytics practice in Sydney. You will drive architecture, delivery leadership, and client advisory across complex AI projects leveraging Databricks, Azure AI, and modern MLOps practices.

The role requires hands-on experience with Generative AI, vector databases, RAG pipelines, LangChain/LangGraph, and full-stack development (React/Node.js/Python).

Qualifications

• Databricks expertise mandatory with AI skills.
• Deep Generative AI experience including vector databases and embeddings.
• Experience with RAG pipelines and agent-based architectures.
• Prompt engineering, fine-tuning, and orchestration (LangChain/LangGraph) mandatory.
• Full-stack engineering background (React/Angular, Node.js/Python/Django/Flask).
• Cloud architecture and MLOps/DevOps on Azure (Azure AI Foundry/Search, Prompt Shields).
• Ability to communicate complex concepts to technical and non-technical audiences.
• Consulting or professional services experience including pre-sales and delivery leadership.
• Demonstrated technical leadership mentoring teams and shaping delivery standards.

Responsibilities

• Lead delivery and mentor teams in AI engineering practice.
• Engage in pre-sales and client advisory work.
• Define and enforce delivery standards across projects.
• Communicate complex topics to stakeholders.

Skills

Databricks

Generative AI

Vector databases

Embeddings

RAG pipelines

Agent-based architectures

LangChain

LangGraph

Full-stack engineering

React

Angular

Node.js

Python

Django

Flask

Azure AI Foundry

Azure AI Search

Prompt Shields

Azure

Tools

Azure

Job description

A leading Data & Analytics consultancy is looking for a Databricks engineer with strong AI skills

Obviously you need DATABRICKS with bells on top but also:

• PLEASE NOTE - DATABRICKS IS MANDATORY SO PLEASE DO NOT APPLY IF YOU DO NOT HAVE THESE SKILLS
• Deep expertise and proven experience in Generative AI technologies, including:
• Vector databases and embeddings
• RAG pipelines and agent-based architectures
• Prompt engineering, fine-tuning, and orchestration frameworks (Langchain & LangGraph experience is mandatory)
• Strong full-stack engineering background, including modern front-end frameworks (e.g., React, Angular) and back-end technologies (e.g., Node.js, Python, Django, Flask).
• Proven expertise in cloud architecture and MLOps/DevOps, deploying and scaling AI systems on Azure with proven experience with Azure AI Foundry, Azure AI Search and Prompt Shields.
• Ability to communicate complex technical concepts clearly to both technical and non-technical audiences.
• Experience in consulting or professional services, including pre-sales, client advisory, and delivery leadership.
• Demonstrated success in technical leadership, mentoring teams, shaping delivery standards, and contributing to the growth of an AI or engineering practice.