Barcelona Hybrid Data Engineer - Databricks & ETL/ELT

Capitole; Vitoria; Híbrido; EUR 50.000 - 65.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Free private health insurance

Training budget €1,200/year

Descripción de la vacante

Capitole seeks a Data Engineer in Barcelona in a hybrid setting to develop and maintain robust ETL/ELT pipelines in a Lakehouse environment using Databricks and Azure Data Factory.

You will implement and optimize workflows with Unity Catalog and Delta Lake, ensure data quality, and collaborate with architects and analysts to align data models with the roadmap, applying IaC and data governance practices.

Formación

• Minimum 4 years of experience as a Data Engineer, with a focus on cloud environments (Azure).
• Proven hands-on experience with Databricks (Unity Catalog, Autologger, Spark, Delta Lake).
• Strong knowledge of Python (PySpark) and advanced SQL.
• High level of English.
• Knowledge of data streaming technologies and third-party APIs.
• Familiarity with Infrastructure as Code (IaC) and Data Governance.
• Experience with Scala or knowledge of Microsoft Azure Fabric.

Responsabilidades

• Develop and maintain ETL/ELT pipelines in a Lakehouse environment.
• Build, deploy, and maintain data pipelines using Databricks and Azure Data Factory.
• Implement and optimize workflows using Unity Catalog and Delta Lake Tables.
• Ensure data quality through validations, monitoring, and production incident resolution.
• Work closely with architects and analysts to ensure data models align with the roadmap.

Conocimientos

PySpark

SQL

Databricks Unity Catalog

Azure Cloud

Data pipeline design

English proficiency

Herramientas

Databricks

Azure Data Factory

Delta Lake

IaC tools

Descripción del empleo

Capitole seeks a Data Engineer in Barcelona in a hybrid setting to develop and maintain robust ETL/ELT pipelines in a Lakehouse environment using Databricks and Azure Data Factory.

You will implement and optimize workflows with Unity Catalog and Delta Lake, ensure data quality, and collaborate with architects and analysts to align data models with the roadmap, applying IaC and data governance practices.