Azure Data Engineer — Streaming to Batch Pipelines

MPower Plus; Madrid; Presencial; EUR 45.000 - 65.000; Jornada completa

Descripción de la vacante

MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid. You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.

This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. The ideal candidate will have proven experience in designing and implementing data pipelines.

Formación

• Proven experience in designing and implementing data pipelines.
• Experience with Azure services, particularly ADLS and ADF.
• Strong programming skills in Python and familiarity with Scala and PySpark.

Responsabilidades

• Design and implement Azure Data Factory and manage Azure Data Lake storage (ADLS).
• Build ETL data pipelines using Python, Scala, and PySpark.
• Optimize data models.

Conocimientos

Azure Data Factory

Python

Scala

PySpark

Data Lake management

Descripción del empleo

MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid. You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.

This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. The ideal candidate will have proven experience in designing and implementing data pipelines.