Azure Data Engineer - Real-Time Pipelines

IBM; Helsinki; Hybrid; EUR 60,000 - 90,000; Full time

Job summary

IBM Consulting in Helsinki is seeking a Data Engineer specializing in Data Platforms on Azure to design, build, and operate batch and real-time data pipelines across the Azure cloud ecosystem.

You will work with Azure Synapse Analytics, Data Factory, DataBricks, Event Hub, Cosmos DB, and related services to ensure robust data processing and storage solutions. Collaboration with global teams is encouraged.

Qualifications

• Experience designing batch and real-time data pipelines on Azure.
• Proficiency with Azure data platform components (ADLS2, Blob Storage, Cosmos DB, SQL DW, Synapse).
• Familiarity with open-source data engineering tools (Airflow, dbt) and Spark/Python for data processing.

Responsibilities

• Design, build, and operate batch and real-time data pipelines on Azure services (Synapse Analytics, Data Factory, Databricks, Event Hub).
• Develop the data layer on Cosmos DB, SQL DW, and related storage.
• Apply Azure expertise across Synapse, Spark, Python, and data governance components.
• Implement open-source tools (Airflow, dbt) to support data engineering solutions.
• Operate Azure services such as Event Hub and Streaming Analytics, and Kafka-based pipelines.

Skills

Azure data platform

Python

Spark

Batch and real-time pipelines

Tools

Azure Synapse Analytics

Azure Data Factory

Azure DataBricks

Event Hub

Cosmos DB

ADLS2

Blob Storage

SQL DW

Spark

Python

Airflow

dbt

Kafka

Job description

IBM Consulting in Helsinki is seeking a Data Engineer specializing in Data Platforms on Azure to design, build, and operate batch and real-time data pipelines across the Azure cloud ecosystem.

You will work with Azure Synapse Analytics, Data Factory, DataBricks, Event Hub, Cosmos DB, and related services to ensure robust data processing and storage solutions. Collaboration with global teams is encouraged.