Azure Data Lead: Synapse & PySpark Architect

Delivery Centric Pty Ltd; Sydney; On-site; AUD 180,000 - 260,000; Full time

Job summary

Delivery Centric Pty Ltd is seeking an experienced Azure Data Lead in Sydney to lead data engineering initiatives. The role focuses on Azure Synapse and PySpark to design end-to-end data pipelines and scalable data frameworks, ensuring data quality and audit compliance.

The ideal candidate will have 10+ years of experience, proven leadership in data engineering, and a track record of building metadata-driven frameworks and audit-focused data solutions.

Qualifications

• 10+ years of overall experience, including leading data engineering initiatives.
• Experience designing and implementing end-to-end data pipelines and notebooks.
• Experience building metadata-driven frameworks.
• Experience developing audit frameworks and implementing data quality rules.

Responsibilities

• Design and implement end-to-end data pipelines and notebooks using Azure Synapse and PySpark.
• Build and maintain metadata-driven frameworks to support scalable and reusable data processing.
• Develop audit frameworks to support data traceability and monitoring.
• Implement and maintain data quality rules to ensure data accuracy, consistency, and reliability.
• Lead data engineering initiatives and collaborate with stakeholders to deliver reliable data solutions.

Skills

PySpark

End-to-end pipelines

Metadata-driven frameworks

Data quality rules

Audit frameworks

Tools

Azure Synapse

Job description

Delivery Centric Pty Ltd is seeking an experienced Azure Data Lead in Sydney to lead data engineering initiatives. The role focuses on Azure Synapse and PySpark to design end-to-end data pipelines and scalable data frameworks, ensuring data quality and audit compliance.

The ideal candidate will have 10+ years of experience, proven leadership in data engineering, and a track record of building metadata-driven frameworks and audit-focused data solutions.