Azure Data Engineer

KWAN; Lisboa; Presencial; EUR 55 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Relocation package

Visa sponsorship

Career progression program

Resumo da oferta

KWAN in Lisbon is seeking an Azure Data Engineer to model and transform raw data into enterprise-grade analytical structures. You will build, maintain, and optimize robust ELT pipelines with automated data quality tests, and ensure comprehensive documentation of data assets.

You will collaborate with Data Engineers, Data Scientists, ML Engineers, and Product Owners to deliver reliable data feeds and unified semantic layers, enabling BI and analytics across the business.

Qualificações

• 3+ years of experience in data modeling and architecture.
• Proficiency in pipeline orchestration and automation tools (Azure Data Factory, Airflow, Microsoft Fabric, or Databricks Workflows).
• Advanced SQL and performance tuning.
• Advanced data transformation using Python and Spark (PySpark, Spark SQL).
• CI/CD pipelines and DevOps for data engineering.
• Familiar with data quality frameworks and observability.
• Data governance, cataloging, and lineage (Purview/Unity Catalog).
• BI modeling and Power BI optimization.
• Cloud data warehousing and lakehouse architectures (BigQuery, Snowflake, Synapse, Delta Lake, ADLS, Redshift).
• Fluency in English.

Responsabilidades

• Model and transform raw data into enterprise-grade analytical structures.
• Build, maintain, and optimize ELT pipelines with automated data quality tests.
• Document data assets, including business rules, data lineage, and transformation logic.
• Monitor dataset health, data quality metrics, SLAs, and pipeline performance.
• Support Data Science, BI, and ML teams with reliable data feeds and unified semantic layers.
• Collaborate with Data Engineers, Data Scientists, ML Engineers, and Product Owners to deliver integrated, value-driven solutions.

Conhecimentos

Data modeling

SQL

Python

Spark

Data orchestration

CI/CD

Data governance

BI modeling

English

Ferramentas

Azure Data Factory

Apache Airflow

Databricks Workflows

Microsoft Fabric

Power BI

Purview

Unity Catalog

Delta Lake

BigQuery

Snowflake

Synapse

ADLS

Redshift

Descrição da oferta de emprego

We are looking for a Azure Data Engineer in Lisbon who's eager to embark on an exciting new opportunity!

About KWAN

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

What is this challenge about

• Model and transform complex raw data into consistent, enterprise-grade analytical structures.
• Build, maintain, and optimize robust ELT pipelines along with automated data quality tests.
• Ensure comprehensive documentation of data assets, including business rules, data lineage, and transformation logic.
• Monitor dataset health, data quality metrics, SLAs, and overall pipeline performance.
• Support Data Science, Business Intelligence, and Machine Learning teams by providing reliable data feeds and unified semantic layers.
• Collaborate closely with Data Engineers, Data Scientists, Machine Learning Engineers, and Product Owners to deliver integrated, value-driven solutions.

What we are looking for

• 3+ years of experience in data modeling and architecture, including star schema design, dimensional modeling, medallion architecture, schema evolution management, and semantic layer design.
• Proficiency in pipeline orchestration and automation tools, such as Azure Data Factory, Apache Airflow, Microsoft Fabric, or Databricks Workflows.
• Advanced SQL expertise and performance engineering skills, including query tuning, partitioning, clustering, and handling large data volumes.
• Advanced data transformation skills using Python and Spark, including PySpark, Spark SQL, and structured Python development.
• Practical experience implementing CI/CD pipelines, version control, and DevOps best practices tailored for data engineering workflows.
• Strong familiarity with data quality frameworks and observability, including rule definition, automated data validation, and end-to-end operational monitoring.
• Practical experience with data governance, cataloging, and lineage tracing using enterprise platforms like Microsoft Purview or Unity Catalog.
• Deep knowledge of BI modeling and performance optimization, including advanced semantic modeling in Power BI, DAX optimization, and efficient analytical model design.
• Hands‑on experience with cloud data warehousing and lakehouse architectures (e.g., BigQuery, Snowflake, Synapse, Delta Lake, ADLS, Redshift) and a strong understanding of system interdependencies.
• Fluency in English.

What we offer

• A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
• A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
• An empowering and respectful work culture enriched with social and learning events.
• A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.
• A relocation package and visa sponsorship for all our international hires.

Some Words From Our Colleagues

“At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.” - Luis Caldeira, DevOps @ KWAN