Senior Azure Data Engineer: Lakehouse & Pipelines Expert

Aubay Portugal; Lisboa; Presencial; EUR 55 000 - 85 000; Tempo integral

Resumo da oferta

Devoteam is seeking a Mid-Senior Data Engineer to design and implement scalable data pipelines using Azure and Microsoft Fabric in Lisbon, Portugal. You will work on Lakehouse architectures, ETL/ELT processes, and data models that enable analytics across teams.

Join a global digital transformation leader and collaborate with data architects, BI teams and data scientists to ensure data quality, governance, and robust performance across the platform.

Qualificações

• 3+ years of Data Engineer experience
• Hands-on experience with Microsoft Azure data services
• Experience with Microsoft Fabric (Lakehouse, pipelines, notebooks)
• Strong knowledge of PySpark / Spark SQL
• Experience with Azure Data Factory or Fabric Data Pipelines, Azure Data Lake Storage / OneLake
• SQL skills and experience working with large datasets
• Familiarity with Delta Lake / Lakehouse architectures
• Experience with CI/CD and DataOps practices (Azure DevOps or GitHub)

Responsabilidades

• Design and implement scalable data pipelines and data processing solutions using Azure and Microsoft Fabric
• Develop and optimize ETL/ELT processes for large-scale datasets
• Work with Lakehouse architectures (Medallion – Bronze, Silver, Gold) using Fabric or Azure Databricks
• Integrate data from multiple sources using Azure Data Factory / Fabric Data Pipelines
• Build and maintain data models and Lakehouse structures in OneLake
• Ensure data quality, reliability, and performance across the platform
• Optimize Spark workloads and data transformations using PySpark and SQL
• Collaborate with Data Architects, BI teams and Data Scientists to enable analytics and reporting
• Contribute to DataOps practices, CI/CD pipelines and automation
• Support data governance and security best practices across the platform

Conhecimentos

Data pipeline design

SQL proficiency

Collaborative analytics

Formação académica

Relevant degree in Computer Science / Data Engineering or equivalent

Ferramentas

Azure Data Factory

Azure Data Lake Storage

Microsoft Fabric

Azure Databricks

PySpark

Spark SQL

OneLake

Descrição da oferta de emprego

Devoteam is seeking a Mid-Senior Data Engineer to design and implement scalable data pipelines using Azure and Microsoft Fabric in Lisbon, Portugal. You will work on Lakehouse architectures, ETL/ELT processes, and data models that enable analytics across teams.

Join a global digital transformation leader and collaborate with data architects, BI teams and data scientists to ensure data quality, governance, and robust performance across the platform.