Data Engineer — Azure Databricks & Lakehouse Expert

ARMIS Group; Porto; Presencial; EUR 40 000 - 60 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Career growth

Impactful projects

Collaborative environment

Resumo da oferta

ARMIS Group is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Azure Databricks in a fast-paced, innovation-driven environment.

You will develop ETL/ELT processes, implement Lakehouse architectures, and collaborate with analysts, scientists, and stakeholders to deliver data-driven insights. Strong SQL, Python, and Power BI skills are essential, with English fluency required.

Qualificações

• Minimum 2 years of full-time experience in Data Engineering or a related field.
• Experience building and maintaining data solutions using Azure Databricks.
• Good knowledge of PySpark, Spark SQL, and data processing frameworks.
• Experience designing and implementing ETL/ELT pipelines.
• Knowledge of Azure Data Lake Storage (ADLS Gen2) and cloud-based data architectures.
• Experience working with Power BI, including data modelling, report development, and performance optimization.
• Good knowledge of SQL and relational databases.
• Experience with Git and version control practices.
• Experience working with data quality, data validation, and monitoring processes.
• Good understanding of data warehousing concepts, including dimensional modelling (Star/Snowflake schemas).
• Nice-to-have: Microsoft Fabric, Azure Data Factory, Delta Lake, Unity Catalog, Medallion Architecture, Azure Synapse Analytics, CI/CD, Azure DevOps, Data Governance, Microsoft Purview, Python, REST APIs, Streaming Data, Kafka, and IaC (Terraform/Bicep).
• Professional proficiency in English, both written and spoken, is mandatory.

Responsabilidades

• Design, develop, and maintain scalable data pipelines using Azure Databricks.
• Build and optimize ETL/ELT processes for ingesting, transforming, and delivering data.
• Implement and manage data solutions following Lakehouse principles and Medallion Architecture.
• Develop, maintain, and optimize data models to support business reporting and analytics.
• Create and support Power BI datasets, reports, and dashboards.
• Ensure data quality, reliability, security, and governance across the data platform.
• Monitor and troubleshoot data processing workflows and performance issues.
• Collaborate with Data Analysts, BI Developers, Data Scientists, and stakeholders to deliver data-driven solutions.
• Participate in defining data architecture standards, best practices, and governance frameworks.
• Contribute to automation, CI/CD pipelines, and operational excellence initiatives.
• Work within multidisciplinary teams following Agile methodologies.

Conhecimentos

Azure Databricks

PySpark

Spark SQL

ETL/ELT

Azure Data Lake Storage

Power BI

SQL

Git

Data modeling

Python

REST APIs

Streaming data

CI/CD

Ferramentas

Azure Databricks

Azure Data Factory

Delta Lake

Unity Catalog

Medallion Architecture

Azure Synapse

Terraform/Bicep

Descrição da oferta de emprego

ARMIS Group is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Azure Databricks in a fast-paced, innovation-driven environment.

You will develop ETL/ELT processes, implement Lakehouse architectures, and collaborate with analysts, scientists, and stakeholders to deliver data-driven insights. Strong SQL, Python, and Power BI skills are essential, with English fluency required.