Hybrid Azure Data Engineer: Databricks & Pipelines

iTRTech Group; Lisboa; Híbrido; EUR 30 000 - 33 000; Tempo integral

Resumo da oferta

iTRTech Group in Lisbon, Portugal is seeking a Data Engineer to deliver scalable data solutions within a hybrid model, focusing on Azure-based data pipelines and governance.

The role requires 3+ years of experience, strong SQL and Python, and hands-on work with Azure Databricks, ADLS Gen2, Delta Lake, and dbt. English and Portuguese proficiency is needed, with two in-office days per week in Lisbon.

Qualificações

• At least 3 years of Data Engineering experience.
• Advanced SQL and Python skills.
• Production experience with Azure Databricks, ADLS Gen2, Delta Lake, Spark/PySpark.
• Hands-on dbt experience.
• Experience with Apache Airflow and Astronomer.
• Knowledge of Azure DevOps, Git, CI/CD.
• Ability to communicate in English; Portuguese B2.

Responsabilidades

• Develop data pipelines using Azure Databricks, ADLS Gen2, Delta Lake and Medallion Architecture.
• Build and maintain dbt models, tests, documentation, and incremental materialisations.
• Create and monitor DAGs with Airflow/Astronomer.
• Ingest data via APIs, SFTP/files, and JDBC.
• Implement SCD Type 2, surrogate keys, schema evolution.
• Establish data quality, metadata, lineage, and auditable delivery.
• Troubleshoot production issues and perform root-cause analysis.
• Apply Git, PRs, CI/CD in Azure DevOps.

Conhecimentos

SQL

Python

Azure

Databricks

dbt

Airflow

Astronomer

Scala

Spark

PySpark

Azure DevOps

Git

CI/CD

Data modelling

Data quality

English

Portuguese

Ferramentas

Azure Databricks

ADLS Gen2

Delta Lake

Delta Tables

Medallion Architecture

Airflow

Astronomer

Git

Descrição da oferta de emprego

iTRTech Group in Lisbon, Portugal is seeking a Data Engineer to deliver scalable data solutions within a hybrid model, focusing on Azure-based data pipelines and governance.

The role requires 3+ years of experience, strong SQL and Python, and hands-on work with Azure Databricks, ADLS Gen2, Delta Lake, and dbt. English and Portuguese proficiency is needed, with two in-office days per week in Lisbon.