DATA ENGINNER / AZURE (HYBRID)

iTRTech Group; Lisboa; Híbrido; EUR 30 000 - 33 000; Tempo integral

Resumo da oferta

iTRTech Group in Lisbon, Portugal is seeking a Data Engineer to deliver scalable data solutions within a hybrid model, focusing on Azure-based data pipelines and governance.

The role requires 3+ years of experience, strong SQL and Python, and hands-on work with Azure Databricks, ADLS Gen2, Delta Lake, and dbt. English and Portuguese proficiency is needed, with two in-office days per week in Lisbon.

Qualificações

• At least 3 years of Data Engineering experience.
• Advanced SQL and Python skills.
• Production experience with Azure Databricks, ADLS Gen2, Delta Lake, Spark/PySpark.
• Hands-on dbt experience.
• Experience with Apache Airflow and Astronomer.
• Knowledge of Azure DevOps, Git, CI/CD.
• Ability to communicate in English; Portuguese B2.

Responsabilidades

• Develop data pipelines using Azure Databricks, ADLS Gen2, Delta Lake and Medallion Architecture.
• Build and maintain dbt models, tests, documentation, and incremental materialisations.
• Create and monitor DAGs with Airflow/Astronomer.
• Ingest data via APIs, SFTP/files, and JDBC.
• Implement SCD Type 2, surrogate keys, schema evolution.
• Establish data quality, metadata, lineage, and auditable delivery.
• Troubleshoot production issues and perform root-cause analysis.
• Apply Git, PRs, CI/CD in Azure DevOps.

Conhecimentos

SQL

Python

Azure

Databricks

dbt

Airflow

Astronomer

Scala

Spark

PySpark

Azure DevOps

Git

CI/CD

Data modelling

Data quality

English

Portuguese

Ferramentas

Azure Databricks

ADLS Gen2

Delta Lake

Delta Tables

Medallion Architecture

Airflow

Astronomer

Git

Descrição da oferta de emprego

DATA ENGINNER / AZURE (HYBRID LISBON)

Portuguese company hires for hybrid position

Location: Lisbon, Portugal

Only candidates already based in Portugal will be considered

Work Model: Hybrid - 2 flexible office days per week

Language Requirements: English B2+ and Portuguese B2

Seniority: Mid-level (3+ years)

Rate Between €2700 - 3000 RV (gross value)

About The Opportunity

We are looking for an autonomous Data Engineer to deliver reliable and scalable data solutions within a complex enterprise environment. The role covers data ingestion, transformation, modelling, orchestration, quality, and governance using the Microsoft Azure ecosystem.

Key Responsibilities

• Develop data pipelines using Azure Databricks, ADLS Gen2, Delta Lake, and Medallion Architecture;
• Build and maintain dbt models, tests, documentation, and incremental materialisations;
• Create and monitor Airflow/Astronomer DAGs;
• Ingest data through APIs, SFTP/files, and JDBC;
• Implement data models, SCD Type 2, surrogate keys, schema evolution, and reconciliation;
• Establish data quality, metadata, lineage, and auditable delivery evidence;
• Troubleshoot production issues and perform root-cause analysis;
• Apply Git, Pull Request, automated validation, and CI/CD practices through Azure DevOps.

Mandatory Requirements

• At least 3 years of relevant Data Engineering experience or equivalent production expertise;
• Advanced SQL and strong Python skills;
• Production experience with Azure, Databricks, ADLS Gen2, Delta Lake, Spark, and PySpark;
• Significant hands-on experience with dbt;
• Experience with Apache Airflow and Astronomer;
• Knowledge of Scala, Databricks Notebooks, and Databricks Jobs;
• Strong data-modelling and data-quality knowledge;
• Experience with Azure DevOps, Git, Pull Requests, and CI/CD;
• Ability to communicate and document technical work in English;
• Portuguese B2.

Nice to Have

Unity Catalog, Microsoft Purview, Azure Monitor, Log Analytics, Microsoft Fabric, Power BI Semantic Models, Microsoft Entra ID, Azure Key Vault, Impala, legacy data lakes and pipelines, Tableau or Pentaho.

Relevant Azure, Databricks, dbt, or Astronomer certifications are also valued.

Ideal Candidate Profile

The ideal candidate is an autonomous and delivery-focused Data Engineer with strong Azure, Databricks, dbt, and Airflow expertise. You are comfortable managing complex production pipelines, solving data-quality issues, and communicating technical decisions to stakeholders.

Questions for Candidates

• How many years of Data Engineering experience do you have?
• What is your production experience with Azure Databricks, ADLS Gen2, and Delta Lake?
• Have you implemented Medallion Architecture and SCD Type 2?
• What is your experience with dbt models, incremental materialisations, tests, and troubleshooting?
• Have you created and maintained DAGs using Airflow or Astronomer?
• Do you have experience ingesting data through APIs, SFTP, files, and JDBC?
• What is your level of proficiency in SQL, Python, Scala, Spark, and PySpark?
• Have you implemented data quality, metadata, lineage, and audit controls?
• Are you available to work twice a week in Lisbon?
• Are your English and Portuguese levels at least B2?
• Is the rate of €2,700-€3,000 RV aligned with your expectations?
• What is your availability to start?

CV Keywords

Data Engineer, Microsoft Azure, Azure Databricks, ADLS Gen2, Delta Lake, Delta Tables, Medallion Architecture, dbt, Apache Airflow, Astronomer, SQL, Python, Scala, Spark, PySpark, APIs, SFTP, JDBC, Data Modelling, SCD Type 2, Surrogate Keys, Schema Evolution, Data Quality, Metadata, Data Lineage, Azure DevOps, Git, Pull Requests, CI/CD, Databricks Notebooks, Databricks Jobs, Unity Catalog, Microsoft Purview, Microsoft Fabric

#00354124