Databricks - Practice Lead / Data & Analytics Consulting

Find My New Job

Melbourne

On-site

AUD 180,000 - 240,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Find My New Job is seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our Databricks practice for enterprise clients in Australia. This role blends hands-on data engineering with leadership, mentoring teams, and guiding business outcomes.

You will design scalable data platforms, review enterprise architectures, and collaborate with clients, delivery managers, and architects to expand Databricks capabilities.

Qualifications

  • 8+ years of professional experience in Data Engineering or Data Platform Engineering.
  • 3+ years of experience leading technical teams, architecture initiatives, or data engineering practices.
  • Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture.
  • Extensive experience with Microsoft Azure services (ADLS, Data Factory, Event Hubs, Key Vault, Azure DevOps).
  • Strong programming skills in Python with clean code practices.
  • Experience with orchestration tools such as Airflow or Dagster.
  • Experience with streaming technologies like Kafka or Azure Event Hubs.
  • Strong understanding of data architecture, metadata management, and enterprise data platform design.
  • Experience implementing data governance, data quality, security, and compliance.

Responsibilities

  • Lead the technical direction and growth of the Databricks Practice, establishing standards and reusable accelerators.
  • Design and review enterprise-scale data platform architectures using Databricks.
  • Provide technical leadership and architectural guidance across client engagements.
  • Partner with clients to understand business challenges and propose scalable data solutions.
  • Lead discovery sessions, workshops, and architecture reviews with clients.
  • Mentor Data Engineers, Tech Leads, and Solution Architects to drive excellence.
  • Define best practices for data & software engineering, DevOps, security, governance, and ops.
  • Drive adoption of Lakehouse, Delta Lake, and event-driven data processing.

Skills

Data engineering leadership
Azure cloud expertise
Python programming
Stakeholder management
Consulting & presentation
Agile / delivery leadership

Tools

Databricks
Azure Data Lake Storage
Azure Data Factory
Azure DevOps
Airflow
Dagster
Kafka

Job description

Job Description

We are seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our clients new Databricks practice.

This role combines deep hands-on expertise in modern data engineering with leadership responsibilities, including defining technical standards, mentoring engineering teams, supporting business development, and delivering scalable cloud-based data solutions for enterprise clients.

You will work closely with clients, engineering teams, solution architects, delivery leaders, and business stakeholders to design innovative data platforms, guide technical decision‑making, and expand the organization's Databricks capabilities. The ideal candidate is both a strong technical leader and a trusted advisor who can bridge business objectives with modern data engineering solutions.

Responsibilities
  • Lead the technical direction and growth of the Databricks Practice, establishing standards, best practices, and reusable solution accelerators.
  • Design and review enterprise‑scale data platform architectures using Databricks.
  • Provide technical leadership and architectural guidance across multiple client engagements.
  • Partner with clients to understand business challenges and recommend scalable data and analytics solutions.
  • Lead technical discovery sessions, solution workshops, architecture reviews, and design discussions with clients.
  • Mentor and coach Data Engineers, Technical Leads, and Solution Architects, fostering technical excellence and career development.
  • Define best practices for data engineering, software engineering, DevOps, security, governance, and operational excellence.
  • Establish standards for ETL/ELT development, data quality, monitoring, performance optimization, and production support.
  • Drive adoption of modern data architectures, including Lakehouse, Delta Lake, and event‑driven data processing.
  • Collaborate with Delivery Managers and Engineering Managers to support project planning, staffing, technical risk management, and solution quality.
  • Support pre‑sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof‑of‑concept initiatives.
  • Stay current with Databricks platform capabilities and emerging technologies, identifying opportunities to improve services and expand practice offerings.
  • Promote the adoption of AI‑assisted software development and engineering best practices across the practice.
Qualifications
  • 8+ years of professional experience in Data Engineering, Data Platform Engineering, or related disciplines.
  • 3+ years of experience leading technical teams, architecture initiatives, or data engineering practices.
  • Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture.
  • Extensive experience with Microsoft Azure, including services such as Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Event Hubs, Azure Key Vault, and Azure DevOps.
  • Strong programming skills in Python, including clean coding practices and object‑oriented programming principles.
  • Experience with orchestration tools such as Apache Airflow or Dagster.
  • Experience working with streaming technologies such as Apache Kafka or Azure Event Hubs.
  • Strong understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design.
  • Experience implementing data governance, data quality, security, and compliance practices.
  • Experience building and optimizing enterprise ETL/ELT solutions.
  • Strong knowledge of SQL and relational database concepts.
  • Experience deploying cloud‑native data solutions, preferably on Microsoft Azure.
  • Excellent consulting, presentation, and stakeholder management skills with experience interacting directly with enterprise clients.
  • Experience leading architecture discussions, technical governance, and solution reviews.
  • Ability to lead multiple initiatives simultaneously while providing technical direction across distributed teams.
  • Experience working in Agile development environments.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

DX1 • Melbourne

On-site
AUD 160,000 - 230,000
Databricks Practice Lead
Databricks Practice Lead

Vivanti Consulting • Western Australia

On-site
AUD 180,000 - 240,000
Growth platform
Mentoring programme
360 reviews
+5
Senior Databricks Engineer
Senior Databricks Engineer

Synogize Pty Ltd. • Melbourne

On-site
AUD 150,000 - 230,000
Databricks Practice Lead - Data Platform Strategy
Databricks Practice Lead - Data Platform Strategy

Find My New Job • Melbourne

On-site
AUD 180,000 - 240,000
Databricks Architect
Databricks Architect

Unison Group • Sydney

On-site
AUD 140,000 - 210,000
Databricks Architect: Lead Scalable Data Platform
Databricks Architect: Lead Scalable Data Platform

Unison Group • Sydney

On-site
AUD 140,000 - 210,000
Senior Data and Analytics Engineer
Senior Data and Analytics Engineer

SG Fleet • Sydney

On-site
AUD 150,000 - 210,000
Wellness days
Parental leave
Learning budget
Senior Designated Support Engineer
Senior Designated Support Engineer

Neon • Sydney

On-site
AUD 150,000 - 210,000
Sr. Solutions Architect (Energy)
Sr. Solutions Architect (Energy)

Neon • Sydney

On-site
AUD 200,000 - 280,000
Data Engineer
Data Engineer

Sirius. • Melbourne

Hybrid
AUD 140,000 - 180,000
Hybrid working model
Professional development budget
Top locations