Azure Data Engineer: Pipelines, ETL & Analytics

Deco Proteste; Portugal; Teletrabalho; EUR 42 000 - 65 000; Tempo integral

Resumo da oferta

Deco Proteste is seeking a Data Engineer to join the Data & Analytics team in Portugal. You will design, build, and optimize data ingestion pipelines across batch and streaming sources, while implementing scalable cloud-based solutions and ensuring data quality for analytics and reporting.

Responsibilities include ETL/ELT development, data transformation scripting, and collaboration with analysts, scientists, and stakeholders in a fast-paced data-driven environment.

Qualificações

• Minimum 3 years of experience in Data Engineering or similar role.
• Strong experience with Python for data processing and scripting, and with ingestion pipelines.
• Proficient in SQL for data manipulation and analysis.
• Hands-on experience with Microsoft Azure data services (ADF, Databricks, Data Lake, Synapse).
• Familiarity with data modeling concepts and version control (Git).
• Fluent in English.

Responsabilidades

• Design, build, and maintain data ingestion pipelines from multiple sources (batch and streaming).
• Develop and optimize ETL/ELT processes to support analytics and reporting needs.
• Create and maintain scripts for data transformation and orchestration.
• Implement scalable cloud-based data solutions and ensure data quality and performance.
• Collaborate with Data Analysts, Data Scientists, and business stakeholders.
• Troubleshoot data issues in production and contribute to CI/CD best practices.

Conhecimentos

Python

Data ingestion pipelines

SQL

Scripting & automation

Data modeling concepts

Git

Ferramentas

Azure Data Factory

Azure Databricks

Azure Data Lake

Synapse Analytics

Git

Descrição da oferta de emprego

Deco Proteste is seeking a Data Engineer to join the Data & Analytics team in Portugal. You will design, build, and optimize data ingestion pipelines across batch and streaming sources, while implementing scalable cloud-based solutions and ensuring data quality for analytics and reporting.

Responsibilities include ETL/ELT development, data transformation scripting, and collaboration with analysts, scientists, and stakeholders in a fast-paced data-driven environment.