Senior AEM Developer

Puratos; Madrid; Presencial; EUR 45.000 - 75.000; Jornada completa

Descripción de la vacante

An innovative company is seeking a Senior Data Engineer to enhance its data capabilities in Spain. This role involves designing and optimizing data pipelines, ensuring data security, and collaborating with stakeholders to improve data governance. The ideal candidate will have extensive experience with Databricks, Azure Data Lake, and strong programming skills in Python and SQL. Join a forward-thinking team where your expertise will play a crucial role in shaping data solutions that drive business success.

Formación

• 5+ years of experience in Databricks and big data processing.
• Strong programming skills in Python and SQL.
• Understanding of Data Governance concepts.

Responsabilidades

• Design and optimize data pipelines and ETL workflows using Databricks.
• Implement data transformation solutions in Databricks with Python and SQL.
• Collaborate with stakeholders to improve data quality.

Conocimientos

Databricks

Python

SQL

Data Governance

Azure Data Lake Storage (ADLS)

Azure Data Factory (ADF)

Problem-solving

Herramientas

Azure Purview

Alation

Collibra

Descripción del empleo

Our goal is to strengthen the brand in Spain. We are looking for an expert to work as a Senior Data Engineer.

Responsibilities:

1. Design, develop, and optimize data pipelines and ETL workflows using Databricks.
2. Implement data transformation and processing solutions in Databricks using Python and SQL.
3. Ensure data security, governance, and compliance by following industry best practices.
4. Work with Azure Data Lake Storage (ADLS) to efficiently store, manage, and process large datasets.
5. Collaborate with stakeholders to define data governance frameworks and improve data quality.
6. Integrate Azure Data Factory (ADF) pipelines to support data ingestion and transformation processes.

Minimum Requirements:

• 5+ years of experience in Databricks and big data processing.
• Hands-on experience with Azure Data Lake (ADLS).
• Strong programming skills in Python and SQL.
• Understanding of Data Governance concepts, including data quality, metadata management, and security policies.
• Experience in performance tuning and optimization of data pipelines.
• Familiarity with Azure Data Factory (ADF) is a plus.
• Strong problem-solving skills and ability to work in an agile environment.

Preferred Skills:

• Experience with Data Cataloging tools (e.g., Azure Purview, Alation, or Collibra).
• Knowledge of CI/CD pipelines for data engineering.