Senior Data Engineer - Azure Databricks & Data Vault

Talan; Barcelona; Presencial; EUR 55.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote within Spain

International projects

Descripción de la vacante

Talan is seeking an experienced Data Engineer to join its data engineering team in a Microsoft Azure and Databricks environment. You will design, develop and maintain scalable data pipelines and data platforms to support BI and analytics in a modern cloud setup.

You will collaborate with Data Architects, Developers and Analysts to translate requirements into robust data solutions, ensuring data quality, governance and performance across large datasets.

Formación

• Proven professional experience as a Data Engineer.
• Strong hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks.
• Good programming skills in Python.

Responsabilidades

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks.
• Develop efficient data processing and transformation solutions using Python and Databricks.
• Work with large and complex datasets, ensuring data quality, reliability and performance.
• Contribute to the design and implementation of modern data architectures within the Azure ecosystem.
• Work with Medallion Architecture principles to build robust data solutions.
• Support the development of Data Vault and Business Vault architectures using Databricks on Azure.
• Work with Microsoft Fabric and OneLake, including shortcuts to integrate and access data across platforms.
• Contribute to data modelling activities within Azure Data Warehouse and related analytical environments.
• Collaborate with Data Architects, Developers and Analysts to translate requirements into technical solutions.
• Identify opportunities to improve data processing, architecture, performance and automation.
• Ensure solutions follow best practices around scalability, security, maintainability and data governance.

Conocimientos

Azure Data Factory

Azure Databricks

Python

SQL

ETL/ELT

Data Modelling

Descripción del empleo

Talan is seeking an experienced Data Engineer to join its data engineering team in a Microsoft Azure and Databricks environment. You will design, develop and maintain scalable data pipelines and data platforms to support BI and analytics in a modern cloud setup.

You will collaborate with Data Architects, Developers and Analysts to translate requirements into robust data solutions, ensuring data quality, governance and performance across large datasets.