Azure Data Engineer

MPower Plus; Madrid; Presencial; EUR 45.000 - 65.000; Jornada completa

Descripción de la vacante

MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid. You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.

This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. The ideal candidate will have proven experience in designing and implementing data pipelines.

Formación

• Proven experience in designing and implementing data pipelines.
• Experience with Azure services, particularly ADLS and ADF.
• Strong programming skills in Python and familiarity with Scala and PySpark.

Responsabilidades

• Design and implement Azure Data Factory and manage Azure Data Lake storage (ADLS).
• Build ETL data pipelines using Python, Scala, and PySpark.
• Optimize data models.

Conocimientos

Azure Data Factory

Python

Scala

PySpark

Data Lake management

Descripción del empleo

Data Engineer – Streaming to Batch Migration (Azure)

Location: Madrid, Community of Madrid, Spain

Responsibilities:

• Design and implement Azure Data Factory and manage Azure Data Lake storage (ADLS).
• Build ETL data pipelines using Python, Scala, and PySpark.
• Optimize data models.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Engineering and Information Technology

Industry

• IT Services and IT Consulting