Hibrido BCN - Senior Data Engineer

Capitole; Barcelona; Presencial; EUR 70.000 - 110.000; Jornada completa

Descripción de la vacante

Capitole is seeking a Senior Data Engineer to join our growing team in Barcelona. You will own the design and delivery of data products on an Azure-based Data Platform and Lakehouse architecture, building scalable pipelines with Databricks, ADF, and Airflow.

Collaborating with product owners and architects, you will refine business requirements, ensure data quality, and drive operational excellence across run and data teams. A strong background in PySpark, SQL, and BI tools is essential.

Formación

• 6+ years of experience in data engineering.
• Strong Python (PySpark) and SQL.
• Experience with Azure Data Platform including Databricks, Unity Catalog, Airflow, Data Factory.
• Knowledge of Medallion Architecture (Bronze/Silver/Gold).
• Experience building scalable data pipelines and data products.

Responsabilidades

• Hands-on data product development using Azure Data Factory and Airflow.
• Develop transformations in Databricks using PySpark/SQL to create data products.
• Follow Medallion Architecture: Bronze, Silver, Gold layers.
• Collaborate with Architects and POs to refine requirements.
• Support run/ops and optimize performance and reliability.

Conocimientos

Data engineering

Python (PySpark)

SQL

Azure Data Platform

Azure Data Factory

Apache Airflow

Databricks

Data Lakehouse

BI tools

Herramientas

Azure Data Factory

Databricks

Apache Airflow

Power BI

Tableau

Unity Catalog

Descripción del empleo

Responsibilities:

• Raise important questions during business maturation in order to detect risks before development stage.

Descripción

Capitole is growing fast, and we want you to be part of the journey!

We are looking for a Senior Data Engineer with +6 years of experience to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture.

This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.

Responsibilities:

Hands-on Data Product development

• Implement scalable, reliable and reusable data pipelines using Azure Data Factory and Apache Airflow.
• Develop data transformations in Azure Databricks (PySpark / SQL) to create/extend data products following the Medallion Architecture layers:
• Bronze (raw ingestion)
• Silver (cleansed & conformed)
• Gold (business-ready data products)
• Optimize performance, cost, and reliability of data workloads.
• Raise important questions during business maturation in order to detect risks before development stage.

Technical Leadership

• Participate in architecture reviews and technical decision-making.
• Promote engineering excellence through code reviews and design reviews.
• Collaborate with Architects, Product Owners in data product technical maturation.

Support & Operations (Run Team Collaboration)

• Provide support to the Run/Operations team for production pipelines and data products for complex topics.
• Troubleshoot and resolve data incidents, failures, and performance issues
• Participate in incident management, root cause analysis, and post-mortems.
• Ensure proper handover, documentation, and operational readiness of developed solutions.
• Contribute to improving runbooks, monitoring, and operational processes.

Requirements:

Technical Skills

• 6+ years of experience in data engineering
• Strong technical expertise with:
• Python (PySpark)
• SQL (advanced level)
• Hands-on experience with Azure-based Data Platform including:
• Databricks
• Unity Catalog
• Apache Airflow
• Azure Data Factory
• Reporting and BI tools (Power BI, Tableau or similar)
• Solid understanding of data modelling fundamentals, main architectures and design patterns
• Data Warehouse, Data Lake and Data Lakehouse