Senior Engineer, Data Engineering

Capitole; Vitoria; Híbrido; EUR 50.000 - 65.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Free private health insurance

Training budget €1,200/year

Descripción de la vacante

Capitole seeks a Data Engineer in Barcelona in a hybrid setting to develop and maintain robust ETL/ELT pipelines in a Lakehouse environment using Databricks and Azure Data Factory.

You will implement and optimize workflows with Unity Catalog and Delta Lake, ensure data quality, and collaborate with architects and analysts to align data models with the roadmap, applying IaC and data governance practices.

Formación

• Minimum 4 years of experience as a Data Engineer, with a focus on cloud environments (Azure).
• Proven hands-on experience with Databricks (Unity Catalog, Autologger, Spark, Delta Lake).
• Strong knowledge of Python (PySpark) and advanced SQL.
• High level of English.
• Knowledge of data streaming technologies and third-party APIs.
• Familiarity with Infrastructure as Code (IaC) and Data Governance.
• Experience with Scala or knowledge of Microsoft Azure Fabric.

Responsabilidades

• Develop and maintain ETL/ELT pipelines in a Lakehouse environment.
• Build, deploy, and maintain data pipelines using Databricks and Azure Data Factory.
• Implement and optimize workflows using Unity Catalog and Delta Lake Tables.
• Ensure data quality through validations, monitoring, and production incident resolution.
• Work closely with architects and analysts to ensure data models align with the roadmap.

Conocimientos

PySpark

SQL

Databricks Unity Catalog

Azure Cloud

Data pipeline design

English proficiency

Herramientas

Databricks

Azure Data Factory

Delta Lake

IaC tools

Descripción del empleo

Are you an expert in the data extraction and transformation layer? We are looking for a Data Engineer to join our team in Barcelona in a hybrid working model. You will focus on developing and maintaining robust ETL/ELT pipelines within a Lakehouse environment. You will work with cutting-edge technologies such as Databricks (Unity Catalog) and Spark Declarative Pipelines, playing a key role in building a data platform from scratch. Develop, deploy, and maintain data pipelines (ETL/ELT) using Databricks and Azure Data Factory. Implement and optimize workflows using Unity Catalog and Delta Lake Tables. Ensure data quality through validations, monitoring, and production incident resolution. Work closely with architects and analysts to ensure the integrity of data models and alignment with the roadmap. Minimum 4 years of experience as a Data Engineer, with a focus on cloud environments (Azure). Proven hands-on experience with Databricks (Unity Catalog, Autologger, Spark, Delta Lake). Strong knowledge of Python (PySpark) and advanced SQL. High level of English. Knowledge of data streaming technologies and third-party APIs. Familiarity with Infrastructure as Code (IaC) and Data Governance. Experience with Scala or knowledge of Microsoft Azure Fabric. 1,200 per year for training and professional development. Free private health insurance. We know how important it is to learn about the company, its culture, and the opinions of other professionals in the industry. That's why we encourage you to research us on Glassdoor. Empowering People, Unlocking Innovation Information Security The employee will be required to comply with the company's information security policies:

• They will have access to confidential information related to Capitole and the project they are working on.
• They must comply with the security policies and internal guidelines of both the company and the client.