Senior Data Engineer - Microsoft Fabric & Data Pipelines

Yarra Trams; City of Melbourne; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Free travel pass

Competitive salary and conditions

Health and wellbeing programs (flu vac

Discounted gym memberships

Employee Assistance Program (EAP)

Paid parental leave

Job summary

Yarra Trams is seeking a Senior Data Engineer to join our Data and Integration team in Melbourne. You will design, build and maintain scalable data pipelines on the Microsoft Fabric platform, enabling trusted enterprise information for performance, contractual obligations and strategic decisions.

You will work across Fabric components, establish standards and governance, and deliver self-service analytics and enterprise reporting.

Qualifications

• Minimum 5 years' experience in enterprise data engineering.
• Strong Microsoft Fabric experience.
• Advanced SQL and PySpark skills.
• Experience with Lakehouse and medallion architecture.
• Experience with Microsoft Fabric administration and capacity management.
• Knowledge of data governance, lineage, metadata and security controls.
• Experience with automated testing, source control and CI/CD practices.
• Strong stakeholder engagement, communication and problem-solving skills.

Responsibilities

• Design, build and maintain scalable Microsoft Fabric data pipelines and data products using OneLake, Lakehouse, Warehouse, Data Factory and Fabric notebooks.
• Develop and optimise batch and near real-time data ingestion and transformation solutions using SQL, PySpark, Dataflows Gen2 and Fabric workloads.
• Implement medallion architecture patterns and scalable data models.
• Apply governance, lineage, metadata and security standards.
• Administer and optimise Microsoft Fabric capacities.
• Develop monitoring, alerting and observability capabilities.
• Maintain CI/CD and engineering standards.
• Produce and maintain technical documentation.
• Support operational service management activities.

Skills

Microsoft Fabric

SQL

PySpark

Data governance

CI/CD

Stakeholder engagement

Tools

Azure Data Factory

Databricks

Synapse Analytics

Job description

Yarra Trams is seeking a Senior Data Engineer to join our Data and Integration team in Melbourne. You will design, build and maintain scalable data pipelines on the Microsoft Fabric platform, enabling trusted enterprise information for performance, contractual obligations and strategic decisions.

You will work across Fabric components, establish standards and governance, and deliver self-service analytics and enterprise reporting.