Distributed Cloud | Azure Data Engineer

Devoteam; Porto; Presencial; EUR 40 000 - 60 000; Tempo integral

Resumo da oferta

A technology consulting firm in Porto is seeking an experienced Azure Data Engineer to design and optimize data pipelines within the Azure ecosystem. The ideal candidate has extensive experience with Azure data services, strong skills in SQL, and a passion for data engineering. This position involves collaborating with data teams and ensuring data quality and automation within the data lifecycle.

Qualificações

• 3+ years of proven experience as a Data Engineer.
• Mandatory hands-on expertise with Azure data services.
• Strong proficiency in SQL and data warehousing.
• Expertise in at least one programming language (Python or Scala).
• Experience with Infrastructure as Code tools.

Responsabilidades

• Design and maintain scalable data pipelines and ETL/ELT processes.
• Develop data infrastructure on Azure using ADLS.
• Manage data warehousing solutions with Azure Synapse.
• Implement data quality checks and monitoring.
• Collaborate with Data Scientists and Analysts for data readiness.
• Automate deployment and testing of data infrastructure.
• Provide technical guidance on data architecture.

Conhecimentos

Azure Data Factory

Azure Data Lake Storage (ADLS Gen2)

SQL

Python or Scala

Terraform or ARM Templates

ETL/ELT frameworks

Data warehousing concepts

Data modeling techniques

Streaming data technologies

Descrição da oferta de emprego

At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B. We believe in transforming technology to create value for our clients, partners and employees in a world where technology is developed for people. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople.

Job Description

We are seeking an experienced and dedicated Azure Data Engineer to join our data team. You will be responsible for designing, building, and optimizing robust, scalable, and highly available data pipelines and ETL/ELT solutions exclusively within the Microsoft Azure ecosystem. This role requires a strong focus on utilizing Azure's native data services to ensure data quality, automation, and performance optimization across the data lifecycle.

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using core Azure data services, primarily Azure Data Factory (ADF) and Azure Databricks.
• Develop and optimize data infrastructure on Azure, leveraging Azure Data Lake Storage (ADLS) for scalable data ingestion and storage.
• Implement and manage data warehousing solutions using Azure Synapse Analytics (SQL Pool or Spark Pool) to support analytics and reporting needs.
• Implement data quality checks, monitoring, and validation to ensure accuracy and integrity of data across all Azure systems.
• Collaborate closely with Data Scientists and Data Analysts to ensure data readiness for reporting, analytics, and Machine Learning initiatives.
• Automate deployment, monitoring, and testing of data infrastructure and pipelines using Infrastructure as Code (IaC) tools like Terraform or ARM Templates and CI/CD practices.
• Provide technical guidance and recommendations on data architecture and technology choices within the Azure ecosystem.

Qualifications

• 3+ years of proven experience as a Data Engineer, focusing heavily on building production‑grade data pipelines.
• Mandatory hands‑on expertise with the Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and Azure Synapse Analytics/SQL DW.
• Strong proficiency in SQL and extensive experience with data warehousing concepts and data modeling techniques.
• Expertise in at least one programming language commonly used for data engineering (Python or Scala is highly preferred).
• Experience with Infrastructure as Code (IaC) tools like Terraform or ARM Templates for automating Azure data infrastructure deployment.
• Solid understanding of distributed systems and ETL/ELT frameworks.
• Excellent analytical and problem‑solving skills, with a passion for continuous learning and data governance.

Preferred Skills

• Microsoft Certified: Azure Data Engineer Associate certification (DP‑203).
• Experience with streaming data technologies on Azure (e.g., Azure Event Hubs, Azure Stream Analytics).
• Knowledge of containerization and orchestration (Docker, Kubernetes/AKS).

Additional Information

The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.