Azure Databricks Lead Data Engineer - Hybrid Sydney

u&u Recruitment Partners; Sydney; Híbrido; AUD 190.000 - 240.000; Jornada completa

Descripción de la vacante

u&u Recruitment Partners partners with a large property company to hire an Azure Databricks Expert who will design and build pipelines and own the data platform in Sydney. This senior data engineering role demands deep Azure Databricks expertise and hands-on work with Spark/PySpark, SQL, Delta Lake and Unity Catalogue.

The role sets engineering standards, leads design reviews, and collaborates with BI and software teams in a flexible hybrid Sydney CBD setup.

Formación

• Experienced Senior Data Engineer with Azure Databricks expertise.
• Hands-on with Spark/PySpark, SQL, Delta Lake and Unity Catalog.
• Azure engineering foundations across cloud, data integration, APIs and DevOps.
• Ability to lead as the Databricks SME and set technical direction.
• Collaborative, pragmatic and able to turn complex requirements into scalable, production-ready solutions.

Responsabilidades

• Design, build, test and support enterprise data pipelines and data products.
• Provide specialist expertise across Azure Databricks, Spark/PySpark, SQL, Delta Lake and Unity Catalogue.
• Establish strong engineering practices across CI/CD, testing, observability, lineage and documentation.
• Lead solution design, code reviews and technical problem-solving across complex data initiatives.
• Partner with BI, Software Engineering and business stakeholders to deliver practical, reusable data solutions.

Conocimientos

Azure Databricks

Spark

PySpark

SQL

Delta Lake

Unity Catalog

CI/CD

Observability

Lineage

Documentation

Herramientas

Azure Databricks

Descripción del empleo

u&u Recruitment Partners partners with a large property company to hire an Azure Databricks Expert who will design and build pipelines and own the data platform in Sydney. This senior data engineering role demands deep Azure Databricks expertise and hands-on work with Spark/PySpark, SQL, Delta Lake and Unity Catalogue.

The role sets engineering standards, leads design reviews, and collaborates with BI and software teams in a flexible hybrid Sydney CBD setup.