Azure Data Engineer (Data Marketplace) - Manager Level

Belvedere Recruitment; Warszawa; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Belvedere Recruitment, on behalf of a client in Warsaw, seeks an experienced Data Engineer to design and maintain AI data marketplace ingestion pipelines. You will work with Azure Data Factory, Databricks and Spark within a hybrid 3-month contract to deliver scalable data products.

The role requires 8+ years in data engineering, strong ETL expertise, and cloud data modelling. Collaboration with cross-functional teams is essential to ensure high availability and reliability.

Qualifications

• Experience with Azure Data Factory for data pipelines.
• Proficiency in Python, PySpark and SQL.
• Experience with Apache Spark for big data processing.
• Strong ETL knowledge and data transformation.
• Familiarity with Azure storage solutions including Azure SQL Database, Blob Storage and Data Lake Storage.
• Knowledge of data modelling principles for scalable data warehousing.
• Experience integrating multiple data sources in cloud environments.
• Ability to write modular, testable code for production systems.

Responsibilities

• Build, test and maintain robust data pipelines.
• Manage Azure Data Factory pipelines, activities, triggers and data flows.
• Process large datasets using Azure Databricks, Apache Spark and PySpark.
• Design stable, scalable data ingestion solutions in collaboration with cross-functional teams.
• Collaborate across teams to ensure smooth transitions through ingestion and consumption phases.

Skills

Extensive data engineering experience

Tools

Azure Data Factory

Azure Databricks

Python

PySpark

SQL

Apache Spark

ETL

Azure SQL Database

Data modelling

Cloud

Job description

Belvedere Recruitment, on behalf of a client in Warsaw, seeks an experienced Data Engineer to design and maintain AI data marketplace ingestion pipelines. You will work with Azure Data Factory, Databricks and Spark within a hybrid 3-month contract to deliver scalable data products.

The role requires 8+ years in data engineering, strong ETL expertise, and cloud data modelling. Collaboration with cross-functional teams is essential to ensure high availability and reliability.