Microsoft Fabric & Lakehouse Data Engineer

Today Experts; Wien; Sur place; EUR 60 000 - 90 000; Plein temps

Résumé du poste

Today Experts in Vienna, Austria, seeks a Microsoft Fabric Engineer on a contract basis to design and manage scalable data lakehouses and data warehouses using the central Microsoft OneLake architecture.

You will develop robust data pipelines with Data Factory and Dataflows Gen2, transform large datasets with PySpark/Python/Scala/SQL, and implement data governance to optimise query speed and data quality. Close collaboration with data scientists and Power BI teams will underpin business insights.

Qualifications

• Experience with large-scale data lakes and data warehouses.
• Proficiency in PySpark, Python, Scala or SQL for data processing.
• Knowledge of data governance and data quality practices.
• Collaboration with data scientists, analysts and BI developers.

Responsabilités

• Design, structure and manage scalable data lakehouses and warehouses.
• Develop, orchestrate and monitor data pipelines using Data Factory and Dataflows Gen2.
• Process, clean and transform large datasets with Spark notebooks.
• Implement access policies and monitor data quality and query performance.
• Work with BI and ML teams to enable reliable business insights.

Connaissances

Microsoft Fabric

Data lakehouse

Data warehouse

Data pipelines

PySpark

SQL

Power BI

Data governance

Outils

Azure Data Factory

Dataflows Gen2

Spark notebooks

Description du poste

Today Experts in Vienna, Austria, seeks a Microsoft Fabric Engineer on a contract basis to design and manage scalable data lakehouses and data warehouses using the central Microsoft OneLake architecture.

You will develop robust data pipelines with Data Factory and Dataflows Gen2, transform large datasets with PySpark/Python/Scala/SQL, and implement data governance to optimise query speed and data quality. Close collaboration with data scientists and Power BI teams will underpin business insights.