Lead Data Engineer

U&U Recruitment Partners; Sydney; Hybrid; AUD 190,000 - 240,000; Full time

Job summary

u&u Recruitment Partners partners with a large property company to hire an Azure Databricks Expert who will design and build pipelines and own the data platform in Sydney. This senior data engineering role demands deep Azure Databricks expertise and hands-on work with Spark/PySpark, SQL, Delta Lake and Unity Catalogue.

The role sets engineering standards, leads design reviews, and collaborates with BI and software teams in a flexible hybrid Sydney CBD setup.

Qualifications

• Experienced Senior Data Engineer with Azure Databricks expertise.
• Hands-on with Spark/PySpark, SQL, Delta Lake and Unity Catalog.
• Azure engineering foundations across cloud, data integration, APIs and DevOps.
• Ability to lead as the Databricks SME and set technical direction.
• Collaborative, pragmatic and able to turn complex requirements into scalable, production-ready solutions.

Responsibilities

• Design, build, test and support enterprise data pipelines and data products.
• Provide specialist expertise across Azure Databricks, Spark/PySpark, SQL, Delta Lake and Unity Catalogue.
• Establish strong engineering practices across CI/CD, testing, observability, lineage and documentation.
• Lead solution design, code reviews and technical problem-solving across complex data initiatives.
• Partner with BI, Software Engineering and business stakeholders to deliver practical, reusable data solutions.

Skills

Azure Databricks

Spark

PySpark

SQL

Delta Lake

Unity Catalog

CI/CD

Observability

Lineage

Documentation

Tools

Azure Databricks

Job description

A large property company are looking for an Azure Databricks Expert to design and built pipelines, integrations and own their data platform.

The role

• Act as the Azure Databricks SME, providing deep technical expertise across the data environment;
• Flexible Hybrid model, Sydney CBD;
• $190,000 - $240,000 Package including bonus; and
• Set engineering standards and drive best practice across data design, development and deployment.

A large property company are looking for an Azure Databricks Expert to design and built pipelines, integrations and own their data platform.

The role

• Act as the Azure Databricks SME, providing deep technical expertise across the data environment;
• Flexible Hybrid model, Sydney CBD;
• $190,000 - $240,000 Package including bonus; and
• Set engineering standards and drive best practice across data design, development and deployment.

Responsibilities

• Design, build, test and support enterprise data pipelines and data products;
• Provide specialist expertise across Azure Databricks, Spark/PySpark, SQL, Delta Lake and Unity Catalogue;
• Establish strong engineering practices across CI/CD, testing, observability, lineage and documentation;
• Lead solution design, code reviews and technical problem-solving across complex data initiatives; and
• Partner with BI, Software Engineering and business stakeholders to deliver practical, reusable data solutions.

About you

• An experienced Senior Data Engineer with deep Azure Databricks expertise;
• Strong hands-on capability across Spark/PySpark, SQL, Delta Lake and Unity Catalogue;
• Strong Azure engineering foundations across cloud, data integration, APIs and DevOps;
• Comfortable operating as the Databricks SME, setting technical direction and supporting other engineers; and
• Pragmatic and collaborative, with the ability to turn complex requirements into scalable, production-ready solutions.

Atu&uRecruitment Partners, we value diversity,equityand inclusion. We welcome applications from Aboriginal and Torres Strait Islander people, people with diverse cultural and linguistic backgrounds and people with disability.

Should yourequirereasonable adjustmentsthroughout the recruitment process(including alternate formats to apply),or have a preferred method of communication,we encourage you to make a request via***********@uandu.comorcontactu&uon02 8245 7***to discuss.In response to these requests, we will collaborate closely with you to implement theappropriate adjustments.

Additionally, for a barrier-free and inclusive online experience, you can accessu&u’sopportunities using accessibility software Recite Me athttps://www.uandu.com/jobs.