Microsoft Fabric Engineer

Today Experts; Wien; Vor Ort; EUR 60.000 - 90.000; Vollzeit

Zusammenfassung

Today Experts in Vienna, Austria, seeks a Microsoft Fabric Engineer on a contract basis to design and manage scalable data lakehouses and data warehouses using the central Microsoft OneLake architecture.

You will develop robust data pipelines with Data Factory and Dataflows Gen2, transform large datasets with PySpark/Python/Scala/SQL, and implement data governance to optimise query speed and data quality. Close collaboration with data scientists and Power BI teams will underpin business insights.

Qualifikationen

• Experience with large-scale data lakes and data warehouses.
• Proficiency in PySpark, Python, Scala or SQL for data processing.
• Knowledge of data governance and data quality practices.
• Collaboration with data scientists, analysts and BI developers.

Aufgaben

• Design, structure and manage scalable data lakehouses and warehouses.
• Develop, orchestrate and monitor data pipelines using Data Factory and Dataflows Gen2.
• Process, clean and transform large datasets with Spark notebooks.
• Implement access policies and monitor data quality and query performance.
• Work with BI and ML teams to enable reliable business insights.

Kenntnisse

Microsoft Fabric

Data lakehouse

Data warehouse

Data pipelines

PySpark

SQL

Power BI

Data governance

Tools

Azure Data Factory

Dataflows Gen2

Spark notebooks

Jobbeschreibung

We are looking for a Microsoft Fabric Engineer on a contract basis for our Austrian partner in the financial services industry.

• Design, structuring and management of scalable data lakehouses and data warehouses based on the central Microsoft OneLake architecture.
• Development, orchestration and monitoring of robust data pipelines for data integration using Data Factory and Dataflows Gen2.
• Data processing & transformation: cleaning, modelling and transforming large datasets using Apache Spark notebooks (via PySpark, Python, Scala or SQL).
• Implementation of access policies, monitoring of data quality (data governance) and continuous optimisation of query and processing speeds.
• Close collaboration with data scientists, analysts and Power BI developers to provide a high-quality data foundation for business reports and machine learning models.