Azure Data Engineer: Architect Scalable Pipelines

Keyrus; Lisboa; Híbrido; EUR 30 000 - 35 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Meal allowance €10.20/day

Flexible benefits plan

Private medical insurance

22 days annual leave

Resumo da oferta

Keyrus Portugal is seeking a data engineer to design and maintain scalable data pipelines using Azure Data Factory and Databricks. You will integrate data from operational systems into data warehouses and downstream applications, while building and orchestrating workflows across Azure services.

The role requires 3+ years in data engineering, strong SQL and Python skills, and fluency in Portuguese and English. Hybrid work in Lisbon area with a focus on scalable, secure data solutions.

Qualificações

• 3+ years of professional experience in Data Engineering, including data integration, transformation, modelling, and pipeline development.
• Strong experience with Microsoft Azure data services and cloud-based data solutions.
• Hands-on experience with Azure Data Factory and Databricks.
• Strong experience with SQL and relational databases/data warehouses.
• Professional experience with Python for data engineering and automation.
• Experience maintaining and evolving existing data platforms while contributing to new data projects.
• Experience working in collaborative and Agile environments.
• Fluent in Portuguese and English.
• Must be a Portuguese or European citizen or have a valid work permit for Portugal.

Responsabilidades

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory, Databricks, SQL, and Python.
• Develop and evolve data processes that integrate data from operational systems into data warehouses, reporting platforms, and other downstream applications.
• Build and orchestrate workflows using Azure services such as Data Factory, Logic Apps, and Function Apps.
• Develop and optimise SQL processes, including complex queries, functions, stored procedures, and data transformations.
• Maintain, troubleshoot, and continuously improve existing data pipelines and data warehouse processes.
• Contribute to new data engineering projects, translating business and technical requirements into robust and maintainable solutions.
• Monitor pipeline performance, data quality, reliability, and operational issues, proactively identifying opportunities for improvement.
• Apply data engineering best practices and contribute to the evolution of the team's cloud-based data architecture.
• Work closely with data engineers, analysts, business stakeholders, and other technical teams to ensure data is accurate, consistent, and fit for purpose.
• Work independently while proactively responding to team and project needs.

Conhecimentos

Azure Data Factory

Databricks

SQL

Python

Data integration

Data warehousing

Portuguese

English

Ferramentas

Azure Databricks

SQL Server

Descrição da oferta de emprego

Keyrus Portugal is seeking a data engineer to design and maintain scalable data pipelines using Azure Data Factory and Databricks. You will integrate data from operational systems into data warehouses and downstream applications, while building and orchestrating workflows across Azure services.

The role requires 3+ years in data engineering, strong SQL and Python skills, and fluency in Portuguese and English. Hybrid work in Lisbon area with a focus on scalable, secure data solutions.