Azure Data Engineer: Scalable Lakehouse & Data Pipelines

mainfyld; Portugal; Presencial; EUR 50 000 - 85 000; Tempo integral

Resumo da oferta

Fyld, a Portuguese consulting company, seeks an experienced Data Engineer to design and develop scalable data pipelines on Microsoft Azure. You will work with Azure Data Factory, Databricks, Synapse and Data Lake Gen2 to build Lakehouse architectures and ensure data governance.

Ideal candidates have strong SQL, Python and PySpark skills, familiarity with Delta Lake, and experience in CI/CD using Azure DevOps and Git. Fluency in English is required; Microsoft Fabric experience is valued.

Qualificações

• Bachelor's degree in Computer Science, Software Engineering, Data Engineering or related fields.
• Experience designing and developing scalable data pipelines on Microsoft Azure.
• Strong knowledge of Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage Gen2.
• Experience with Microsoft Fabric is highly valued
• Strong SQL and Python skills.
• Experience with PySpark and Apache Spark.
• Knowledge of ETL/ELT processes, data modelling and data warehousing concepts.
• Experience working with Delta Lake and modern Lakehouse architectures is valued.
• Familiarity with Azure DevOps, Git and CI/CD pipelines.
• Understanding of Azure security, RBAC and data governance best practices.
• Microsoft Certified: Azure Data Engineer Associate certification is a plus.
• Fluency in English.

Responsabilidades

• Design and develop scalable data pipelines on Microsoft Azure.
• Work with Delta Lake and modern Lakehouse architectures.
• Translate business requirements into data solutions with collaborators across teams.
• Ensure data security, governance and RBAC compliance.

Conhecimentos

SQL

Python

PySpark

Apache Spark

Lakehouse concepts

Formação académica

Bachelor's degree in Computer Science, Software Engineering, Data Engineering or related fields

Ferramentas

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Delta Lake

Azure DevOps

Git

Descrição da oferta de emprego

Fyld, a Portuguese consulting company, seeks an experienced Data Engineer to design and develop scalable data pipelines on Microsoft Azure. You will work with Azure Data Factory, Databricks, Synapse and Data Lake Gen2 to build Lakehouse architectures and ensure data governance.

Ideal candidates have strong SQL, Python and PySpark skills, familiarity with Delta Lake, and experience in CI/CD using Azure DevOps and Git. Fluency in English is required; Microsoft Fabric experience is valued.