Senior Data Engineer for Azure Lakehouse & Data Products

Capitole Consulting; Barcelona; Vor Ort; EUR 70.000 - 110.000; Vollzeit

Benefits dieser Stelle

Professional development stipend

Private health insurance

Meal, transport, childcare vouchers

Wellhub subscription

Capitole Club discounts

Zusammenfassung

Capitole Consulting in Barcelona is seeking a Senior Data Engineer to drive the evolution of our Azure-based Data Platform and Lakehouse. You will build pipelines in ADF, design DAGs in Airflow, and craft Databricks transformations using PySpark and SQL.

You will collaborate with POs, architects, and Run/Ops teams to ensure scalable, observable data products, with a focus on Medallion architecture and solid data modeling. This is a dynamic, growth-focused role in a fast-moving team.

Qualifikationen

• 6+ years of experience in data engineering.
• Strong technical expertise with Python (PySpark) and SQL.
• Hands-on experience with Azure-based Data Platform including Databricks, Unity Catalog, Airflow, and Data Factory.
• Knowledge of Data Warehouse, Data Lake and Lakehouse architectures and Medallion architecture.
• Understanding of partitioning, optimization, and performance for batch and streaming pipelines.

Aufgaben

• Implement scalable data pipelines using Azure Data Factory and Apache Airflow.
• Develop data transformations in Azure Databricks (PySpark/SQL).
• Create and extend data products following Medallion Architecture (Bronze, Silver, Gold).
• Optimize performance, cost and reliability of data workloads.
• Lead architecture reviews and promote engineering excellence.

Kenntnisse

Python (PySpark)

SQL

Data engineering

Tools

Databricks

Azure Data Factory

Apache Airflow

Unity Catalog

Power BI

Tableau

Jobbeschreibung

Capitole Consulting in Barcelona is seeking a Senior Data Engineer to drive the evolution of our Azure-based Data Platform and Lakehouse. You will build pipelines in ADF, design DAGs in Airflow, and craft Databricks transformations using PySpark and SQL.

You will collaborate with POs, architects, and Run/Ops teams to ensure scalable, observable data products, with a focus on Medallion architecture and solid data modeling. This is a dynamic, growth-focused role in a fast-moving team.