Data Engineer - Azure Data Marketplace

BELVEDERE; Warszawa; Hybrid; PLN 200,000 - 260,000; Full time

Benefits offered by this job

Hybrid work arrangement

Job summary

BELVEDERE is seeking a senior Data Engineer in Warsaw to design, build and optimise data ingestion infrastructure for an AI Data Marketplace platform. You will develop robust pipelines, ensure stability and performance, and work with cross-functional teams to shape data products used across the enterprise.

The role requires 8–10 years of data engineering experience, strong Azure Data Factory and Databricks expertise, and proficiency in Python, PySpark and SQL.

Qualifications

• 8–10 years of experience in data engineering roles.
• Expert knowledge of Azure Data Factory pipeline development and management.
• Proficiency with Azure Databricks, notebooks, jobs and clusters.
• Strong programming skills in Python, PySpark and SQL.
• Experience with Apache Spark for big data processing.
• Knowledge of ETL processes and data transformation techniques.
• Familiarity with Azure storage solutions including SQL Database, Blob Storage and Data Lake Storage.
• Understanding of data warehousing principles and scalable data modelling.
• Experience with PL/SQL.
• Ability to write modular, testable and maintainable code.
• Strong collaboration and communication skills.

Responsibilities

• Identify and develop opportunities to improve data assets and services.
• Design and build data ingestion pipelines focused on stability and optimisation.
• Develop, test and maintain robust data pipelines and processes.
• Write resilient, fault-tolerant and modular code for high availability.
• Research and implement new methods to build world-class data products.
• Collaborate across Ingestion, Consumption and Activation teams.
• Manage Azure Data Factory pipelines, activities, triggers and data flows.
• Process large datasets using Azure Databricks and Apache Spark.
• Transform and integrate data from multiple sources.
• Ensure data pipeline traceability and monitoring.

Skills

Azure Data Factory

PySpark

Python

SQL

Apache Spark

Data modelling

Data warehousing

Cross-functional collaboration

Communication

Tools

Azure Databricks

Azure Data Factory

Apache Spark

Job description

Data Engineer - Azure Data Marketplace

Location: Warsaw

Contract Type: 3 Months Job Type: Hybrid

• Work oncutting-edgeAI data marketplace technology
• Lead data ingestion pipelines using Azure Data Factory and Databricks
• Manager-level contract role with 8-10 years' experiencerequired
• Collaborate across teams on enterprise-scale data solutions
• Shape world-class data products and services

Company Overview

Our client is a global professional servicesorganisationdelivering technology-enabled solutions across consulting, advisory and assurance services. They are building an advanced AI-powered data marketplace platform designed to transform how data assets are created,managedand consumed across the enterprise. Theorganisationinvests heavily in innovation and technology, creating opportunities for experienced engineers to work on meaningful projects thatimpactbusiness operations globally. Their commitment to professional development and collaborative working environment makes them an employer of choice for data engineering professionals.

Position Overview

As a Data Engineer, you will playa central rolein developing andmaintainingthe data ingestion infrastructure for the AI Data Marketplace platform. You will design,buildandoptimisedata pipelines that ensure stability,traceabilityand performance across the platform. Working collaboratively with cross-functional teams, you will help shape how data assets are created and consumed, directlyimpactingthe quality and reliability of services delivered to internal stakeholders.This role combines technical expertise with strategic thinking to continuously improve data products and processes.

Responsibilities

• Identifyand develop opportunities to improve data assets and services
• Design and build data ingestion pipelines focused on stability andoptimisation
• Develop,testandmaintainrobust data pipelines and processes
• Write resilient, fault-tolerantand modular code for high availability
• Research and implement new methods to build world-class data products
• Collaborate across Ingestion, Consumption and Activation teams
• Manage Azure Data Factory pipelines, activities,triggersand data flows
• Process large datasets using Azure Databricks and Apache Spark
• Transform and integrate data from multiple sources
• Ensure data pipeline traceability and monitoring

Requirements

• 8-10 years of experience in data engineering roles
• Expert knowledge of Azure Data Factory pipeline development and management
• Proficiencywith Azure Databricks, notebooks,jobsand clusters
• Strong programming skills in Python,PySparkand SQL
• Experience with Apache Spark for big data processing
• Knowledge of ETL processes and data transformation techniques
• Familiarity with Azure storage solutions including SQL Database, Blob Storage and Data Lake Storage
• Understanding of data warehousing principles and scalable data modelling
• Experience with PL/SQL
• Ability to write modular,testableand maintainable code
• Strong collaboration and communication skills
• Experience working in cross-functional team environments

Benefits

Whilst specific benefits details are being confirmed,you'lljoin a globallyrecognisedorganisationthat values professional development and technical excellence.You'llbeimmersedinacollaborative environment working alongside skilled engineers and data specialists on meaningful projects that advance AI and data marketplace capabilities.