Senior Data Engineer: Azure Databricks, Data Vault & Cloud

Talan; Madrid; Presencial; EUR 55.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote within Spain Time zone

Multicultural team and international项目

Descripción de la vacante

Talan is an international consulting group specializing in innovation and business transformation through technology. We are hiring a Data Engineer to join a dynamic data engineering team in a Microsoft Azure and Databricks environment, contributing to scalable data solutions and analytics.

You will design and maintain data pipelines, work with large datasets, and help shape modern data architectures within the Azure ecosystem.

Formación

• Proven professional experience as a Data Engineer.
• Strong hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks.
• Good programming skills in Python.
• Solid understanding of data engineering principles, including ETL/ELT, data transformation and data modelling.
• Experience working with cloud-based data platforms and large-scale data processing.
• Good understanding of SQL and relational data concepts.
• Experience with Medallion Architecture (Nice to Have).
• Knowledge of Data Vault / Business Vault methodologies (Nice to Have).
• Experience implementing Data Vault solutions using Databricks on Azure (Nice to Have).
• Experience with Microsoft Fabric and OneLake, particularly OneLake shortcuts (Nice to Have).
• Knowledge of data modelling in Azure Data Warehouse (Nice to Have).
• Experience working within the financial services or wealth management sector (Nice to Have).
• Familiarity with data governance, data quality and modern cloud data architecture principles (Nice to Have).

Responsabilidades

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks.
• Develop efficient data processing and transformation solutions using Python and Databricks.
• Work with large and complex datasets, ensuring data quality, reliability and performance.
• Contribute to the design and implementation of modern data architectures within the Azure ecosystem.
• Work with Medallion Architecture principles to build robust and scalable data solutions.
• Support the development of Data Vault and Business Vault architectures using Databricks on Azure.
• Work with Microsoft Fabric and OneLake, including the use of shortcuts to integrate and access data across different platforms.
• Contribute to data modelling activities within Azure Data Warehouse and related analytical environments.
• Collaborate with Data Architects, Developers, Analysts and other stakeholders to understand requirements and translate them into effective technical solutions.
• Identify opportunities to improve data processing, architecture, performance and automation.
• Ensure solutions follow best practices around scalability, security, maintainability and data governance.

Conocimientos

Data Engineer

Azure Data Factory

Azure Databricks

Python

SQL

Herramientas

Azure Data Factory

Azure Databricks

Descripción del empleo

Talan is an international consulting group specializing in innovation and business transformation through technology. We are hiring a Data Engineer to join a dynamic data engineering team in a Microsoft Azure and Databricks environment, contributing to scalable data solutions and analytics.

You will design and maintain data pipelines, work with large datasets, and help shape modern data architectures within the Azure ecosystem.