Data Engineer: Azure Databricks & Governance | Hybrid Lisbon

QiBit; Lisboa; Hybrid; EUR 45,000 - 55,000; Full time

Job summary

QiBit Portugal (Gi Group Holding) is seeking a Data Engineer to join a team building and evolving a data platform on Azure Databricks, impacting pipelines' quality, governance, and scalability. The role focuses on delivering robust data workflows and collaborating with cross-functional stakeholders in a hybrid Lisbon-based office.

You will develop, optimize ingestion pipelines, implement PySpark transformations, and contribute to governance through Unity Catalog, with opportunities for growth in

Qualifications

• Experience as a Data Engineer in cloud data environments.
• Hands-on experience with Azure Databricks and PySpark development.
• Experience in data ingestion (ETL/ELT) and building reusable pipelines.
• Knowledge of governance, catalogs, and access control, ideally with Unity Catalog.
• Strong collaboration and communication skills in a multidisciplinary team context.
• Nice to have: Databricks Apps; Unity AI Gateway; data lake design and data quality practices.

Responsibilities

• Develop and optimize data ingestion pipelines (batch/streaming) focusing on reliability and performance.
• Implement data transformations in PySpark on Azure Databricks.
• Contribute to governance and permissions through Unity Catalog.
• Support operationalization of Databricks Apps components and align with business needs.
• Collaborate with Data, Cloud, and Analytics teams to translate requirements into scalable solutions.
• Ensure quality, observability, and documentation of pipelines and datasets in a customer lake context.

Skills

Azure Databricks

PySpark

Data pipelines

Cloud data environments

Collaboration

Tools

Unity Catalog

Databricks Apps

Job description

QiBit Portugal (Gi Group Holding) is seeking a Data Engineer to join a team building and evolving a data platform on Azure Databricks, impacting pipelines' quality, governance, and scalability. The role focuses on delivering robust data workflows and collaborating with cross-functional stakeholders in a hybrid Lisbon-based office.

You will develop, optimize ingestion pipelines, implement PySpark transformations, and contribute to governance through Unity Catalog, with opportunities for growth in