Azure Databricks Data Engineer - Hybrid (Lisbon)

iTRTech Group; Lisboa; Híbrido; EUR 30 000 - 33 000; Tempo integral

Resumo da oferta

iTRTech Group is seeking a mid-level Azure Databricks Data Engineer for a hybrid role in Lisbon, Portugal. You will design, build and optimize data pipelines using Azure Databricks, dbt and Airflow, ensuring data quality and governance across ingestion, transformation, and deployment stages.

The role requires 3+ years of experience, strong SQL and Python, and English and Portuguese at B2 level. The position offers a hybrid model with two office days per week and flexibility to collaborate with a

Qualificações

• 3+ years of Data Engineering experience required.
• Advanced SQL and strong Python skills required.
• Production experience with Azure Databricks, ADLS Gen2, Delta Lake and Medallion Architecture.
• Strong dbt experience including models, incremental materialisations, tests and troubleshooting.
• Experience with Airflow/Astronomer DAGs, scheduling, retries and monitoring.
• Data ingestion experience with APIs, SFTP/files and JDBC.
• Knowledge of data modelling, SCD Type 2, surrogate keys, schema evolution, reprocessing and reconciliation.
• Experience with Spark/PySpark, Scala, Databricks Notebooks and Jobs.
• Experience with Git, Azure DevOps, Pull Requests and CI/CD.
• Knowledge of Data Quality, Metadata and Data Lineage.
• English and Portuguese at B2 level (spoken and written).
• Availability for hybrid work in Lisbon.

Responsabilidades

• Develop data pipelines using Azure Databricks, ADLS Gen2 and Delta Lake;
• Implement Medallion Architecture and transformation models with dbt;
• Create and maintain Airflow/Astronomer DAGs;
• Ingest data through APIs, SFTP/files and JDBC;
• Develop solutions using SQL, Python, Scala, Spark and PySpark;
• Implement data modelling, quality, metadata and lineage practices;
• Manage automated validations and deployments through Azure DevOps and CI/CD;
• Troubleshoot production issues and perform root-cause analysis;
• Produce technical documentation and communicate with stakeholders.

Conhecimentos

SQL

Python

Azure Databricks

Airflow

dbt

Spark/PySpark

Git

CI/CD

Data modelling

Data quality

Data lineage

SCD Type 2

APIs ingestion

English

Portuguese

Ferramentas

Azure Databricks Notebooks

Delta Lake

Astronomer

Descrição da oferta de emprego

iTRTech Group is seeking a mid-level Azure Databricks Data Engineer for a hybrid role in Lisbon, Portugal. You will design, build and optimize data pipelines using Azure Databricks, dbt and Airflow, ensuring data quality and governance across ingestion, transformation, and deployment stages.

The role requires 3+ years of experience, strong SQL and Python, and English and Portuguese at B2 level. The position offers a hybrid model with two office days per week and flexibility to collaborate with a