Senior Azure Data Engineer – Synapse & PySpark Expert

FR Consultancy; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

FR Consultancy in Sydney, AU is seeking a Senior Data Engineer with 7+ years of experience to design and build end-to-end data pipelines, ensure data quality and reliability, and collaborate with business and technical teams. The role requires AU valid visa with full work rights and is available as a full-time/permanent/contract position.

You will lead metadata-driven data processing frameworks, implement audit frameworks to track pipeline execution, and work with Azure Synapse Analytics and

Qualifications

• Experience in data engineering, including leading technical initiatives.
• Hands-on with Azure Synapse Analytics and PySpark.
• Design and implement end-to-end data pipelines and notebooks.
• Build and maintain metadata-driven data processing frameworks.
• Develop audit frameworks to track data processing and pipeline execution.
• Implement and maintain data quality rules and validation checks.
• Ensure data accuracy, consistency and reliability across data pipelines.

Skills

Data pipelines

Azure Synapse Analytics

PySpark

Data quality

Audit frameworks

Metadata management

Collaboration

Tools

Azure Synapse Analytics

PySpark

Job description

FR Consultancy in Sydney, AU is seeking a Senior Data Engineer with 7+ years of experience to design and build end-to-end data pipelines, ensure data quality and reliability, and collaborate with business and technical teams. The role requires AU valid visa with full work rights and is available as a full-time/permanent/contract position.

You will lead metadata-driven data processing frameworks, implement audit frameworks to track pipeline execution, and work with Azure Synapse Analytics and