Azure Data Engineer – ELT Pipelines & Data Quality

KWAN; Lisboa; Presencial; EUR 55 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Relocation package

Visa sponsorship

Career progression program

Resumo da oferta

KWAN in Lisbon is seeking an Azure Data Engineer to model and transform raw data into enterprise-grade analytical structures. You will build, maintain, and optimize robust ELT pipelines with automated data quality tests, and ensure comprehensive documentation of data assets.

You will collaborate with Data Engineers, Data Scientists, ML Engineers, and Product Owners to deliver reliable data feeds and unified semantic layers, enabling BI and analytics across the business.

Qualificações

• 3+ years of experience in data modeling and architecture.
• Proficiency in pipeline orchestration and automation tools (Azure Data Factory, Airflow, Microsoft Fabric, or Databricks Workflows).
• Advanced SQL and performance tuning.
• Advanced data transformation using Python and Spark (PySpark, Spark SQL).
• CI/CD pipelines and DevOps for data engineering.
• Familiar with data quality frameworks and observability.
• Data governance, cataloging, and lineage (Purview/Unity Catalog).
• BI modeling and Power BI optimization.
• Cloud data warehousing and lakehouse architectures (BigQuery, Snowflake, Synapse, Delta Lake, ADLS, Redshift).
• Fluency in English.

Responsabilidades

• Model and transform raw data into enterprise-grade analytical structures.
• Build, maintain, and optimize ELT pipelines with automated data quality tests.
• Document data assets, including business rules, data lineage, and transformation logic.
• Monitor dataset health, data quality metrics, SLAs, and pipeline performance.
• Support Data Science, BI, and ML teams with reliable data feeds and unified semantic layers.
• Collaborate with Data Engineers, Data Scientists, ML Engineers, and Product Owners to deliver integrated, value-driven solutions.

Conhecimentos

Data modeling

SQL

Python

Spark

Data orchestration

CI/CD

Data governance

BI modeling

English

Ferramentas

Azure Data Factory

Apache Airflow

Databricks Workflows

Microsoft Fabric

Power BI

Purview

Unity Catalog

Delta Lake

BigQuery

Snowflake

Synapse

ADLS

Redshift

Descrição da oferta de emprego

KWAN in Lisbon is seeking an Azure Data Engineer to model and transform raw data into enterprise-grade analytical structures. You will build, maintain, and optimize robust ELT pipelines with automated data quality tests, and ensure comprehensive documentation of data assets.

You will collaborate with Data Engineers, Data Scientists, ML Engineers, and Product Owners to deliver reliable data feeds and unified semantic layers, enabling BI and analytics across the business.