Azure Data Engineer – Fabric, Lakehouse & Spark

Decskill; Lisboa; Presencial; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

Devoteam is seeking a Data Engineer to design and implement scalable data pipelines and processing solutions on Azure and Microsoft Fabric. You will develop ETL/ELT processes for large-scale datasets and work with Lakehouse architectures using Fabric or Azure Databricks.

You will integrate data from multiple sources with Azure Data Factory / Fabric Data Pipelines and build data models in OneLake, ensuring high data quality and platform performance.

Qualificações

• 3+ years experience as a Data Engineer.
• Hands-on experience with Microsoft Azure data services.
• Experience with Microsoft Fabric (Lakehouse, pipelines, notebooks).
• Strong knowledge of PySpark / Spark SQL.
• Experience with Azure Data Factory or Fabric Data Pipelines, Azure Data Lake.

Responsabilidades

• Design and implement scalable data pipelines and data processing solutions using Azure and Microsoft Fabric.
• Develop and optimize ETL/ELT processes for large-scale datasets.
• Work with Lakehouse architectures (Medallion – Bronze, Silver, Gold) using Fabric or Azure Databricks.
• Integrate data from multiple sources using Azure Data Factory / Fabric Data Pipelines.
• Build and maintain data models and Lakehouse structures in OneLake.
• Ensure data quality, reliability, and performance across the platform.
• Optimize Spark workloads and data transformations using PySpark and SQL.
• Collaborate with Data Architects, BI teams and Data Scientists to enable analytics and reporting.
• Contribute to DataOps practices, CI/CD pipelines and automation.
• Support data governance and security best practices across the platform.

Conhecimentos

Data engineering

PySpark

Spark SQL

Azure Data Factory

Azure Databricks

Microsoft Fabric

Azure Data Lake

ETL/ELT development

Ferramentas

Azure Data Factory

Fabric Data Pipelines

Azure Databricks

OneLake

Descrição da oferta de emprego

Devoteam is seeking a Data Engineer to design and implement scalable data pipelines and processing solutions on Azure and Microsoft Fabric. You will develop ETL/ELT processes for large-scale datasets and work with Lakehouse architectures using Fabric or Azure Databricks.

You will integrate data from multiple sources with Azure Data Factory / Fabric Data Pipelines and build data models in OneLake, ensuring high data quality and platform performance.