Databricks Practice Lead: Data Platform Architect & Coach

Find My New Job; Melbourne; On-site; AUD 180,000 - 240,000; Full time

Job summary

Find My New Job is seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our Databricks practice for enterprise clients.

You will blend hands-on data engineering with leadership, define standards, mentor teams, support business development, and deliver scalable cloud data solutions on Microsoft Azure. You will collaborate with clients and delivery leads to shape architectures and expand capabilities.

Qualifications

• 8+ years of professional experience in Data Engineering, Data Platform Engineering, or related disciplines.
• 3+ years of experience leading technical teams, architecture initiatives, or data engineering practices.
• Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture.
• Extensive experience with Microsoft Azure, including ADLS, ADF, Event Hubs, Key Vault, and Azure DevOps.
• Strong programming skills in Python, including clean coding practices and object‑oriented programming.
• Experience with orchestration tools such as Apache Airflow or Dagster.
• Experience working with streaming technologies such as Apache Kafka or Azure Event Hubs.
• Strong understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design.
• Experience implementing data governance, data quality, security, and compliance practices.
• Experience building and optimizing enterprise ETL/ELT solutions.
• Strong knowledge of SQL and relational database concepts.
• Experience deploying cloud‑native data solutions, preferably on Microsoft Azure.
• Excellent consulting, presentation, and stakeholder management skills with experience interacting directly with enterprise clients.
• Experience leading architecture discussions, technical governance, and solution reviews.
• Ability to lead multiple initiatives simultaneously while providing technical direction across distributed teams.
• Experience working in Agile development environments.

Responsibilities

• Lead the technical direction and growth of the Databricks Practice, establishing standards, best practices, and reusable solution accelerators.
• Design and review enterprise‑scale data platform architectures using Databricks.
• Provide technical leadership and architectural guidance across multiple client engagements.
• Partner with clients to understand business challenges and recommend scalable data and analytics solutions.
• Lead technical discovery sessions, solution workshops, architecture reviews, and design discussions with clients.
• Mentor and coach Data Engineers, Technical Leads, and Solution Architects, fostering technical excellence and career development.
• Define best practices for data engineering, software engineering, DevOps, security, governance, and operational excellence.
• Establish standards for ETL/ELT development, data quality, monitoring, performance optimization, and production support.
• Drive adoption of modern data architectures, including Lakehouse, Delta Lake, and event‑driven data processing.
• Collaborate with Delivery Managers and Engineering Managers to support project planning, staffing, technical risk management, and solution quality.
• Support pre‑sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof‑of‑concept initiatives.
• Stay current with Databricks platform capabilities and emerging technologies, identifying opportunities to improve services and expand practice offerings.
• Promote the adoption of AI‑assisted software development and engineering best practices across the practice.

Skills

Databricks

Azure

Python

SQL

Data governance

Data architecture

Leadership

Agile

Stakeholder management

ETL/ELT

Cloud data platforms

Tools

Databricks platform

Azure DevOps

Airflow

Dagster

Delta Lake

Unity Catalog

Azure Data Factory

Azure Data Lake Storage

Job description

Find My New Job is seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our Databricks practice for enterprise clients.

You will blend hands-on data engineering with leadership, define standards, mentor teams, support business development, and deliver scalable cloud data solutions on Microsoft Azure. You will collaborate with clients and delivery leads to shape architectures and expand capabilities.