Junior Data Engineer

IBM; Helsinki; On-site; EUR 60,000 - 90,000; Full time

Job summary

IBM Consulting in Helsinki is seeking a Data Engineer specializing in Data Platforms on Azure to design, build, and operate batch and real-time data pipelines across the Azure cloud ecosystem.

You will work with Azure Synapse Analytics, Data Factory, DataBricks, Event Hub, Cosmos DB, and related services to ensure robust data processing and storage solutions. Collaboration with global teams is encouraged.

Qualifications

• Experience designing batch and real-time data pipelines on Azure.
• Proficiency with Azure data platform components (ADLS2, Blob Storage, Cosmos DB, SQL DW, Synapse).
• Familiarity with open-source data engineering tools (Airflow, dbt) and Spark/Python for data processing.

Responsibilities

• Design, build, and operate batch and real-time data pipelines on Azure services (Synapse Analytics, Data Factory, Databricks, Event Hub).
• Develop the data layer on Cosmos DB, SQL DW, and related storage.
• Apply Azure expertise across Synapse, Spark, Python, and data governance components.
• Implement open-source tools (Airflow, dbt) to support data engineering solutions.
• Operate Azure services such as Event Hub and Streaming Analytics, and Kafka-based pipelines.

Skills

Azure data platform

Python

Spark

Batch and real-time pipelines

Tools

Azure Synapse Analytics

Azure Data Factory

Azure DataBricks

Event Hub

Cosmos DB

ADLS2

Blob Storage

SQL DW

Spark

Python

Airflow

dbt

Kafka

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your role and responsibilities

As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services.

Your primary responsibilities will include:

• Design and Build Data Pipelines: Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.


• Develop Data Layer: Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.


• Apply Azure Expertise: Apply proficiency in Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.


• Implement Open Source Technologies: Implement open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.


• Operate Azure Services: Operate Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.

Required technical and professional expertise

• Exposure to Azure Toolset: Experience working with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.


• Proficiency in Azure Data Platform: Exposure to Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.


• Data Pipeline Development: Experience working with batch and real-time data pipelines using Azure services, including designing, building, and operating data pipelines.


• Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.


• Azure Services Operation: Experience working with Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.

Preferred technical and professional experience

• Proficiency in Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.


• Knowledge of Azure Services: Experience working with Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.


• Familiarity with Data Pipeline Development: Exposure to designing, building, and operating batch and real-time data pipelines using Azure services.

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.