Data Engineer Manager — Azure & Databricks Platform

Belvedere; Poland; Hybrid; PLN 201,000 - 268,000; Part time

Job summary

Belvedere is seeking a senior Data Engineer in Warsaw to design and maintain data ingestion pipelines for their Azure Data Marketplace platform. You will collaborate with cross-functional teams to ensure stability, scalability, and high availability across ingestion and consumption phases.

The role emphasizes hands-on development in Azure Data Factory, Databricks, PySpark, and Spark, with a focus on robust ETL processes, data integration, and production-grade software design.

Qualifications

• 8-10 years of experience as a Data Engineer.
• ,

Responsibilities

• Identify opportunities to improve data assets and services within the AI Data Marketplace
• Design and develop data ingestion pipelines with focus on stability and optimisation
• Build, test and maintain robust data pipelines and processes
• Write resilient, fault-tolerant and modular code for high availability systems
• Research and implement new methods to enhance data products
• Collaborate across teams to ensure smooth transitions through ingestion and consumption phases
• Manage Azure Data Factory pipelines, activities, triggers and data flows
• Process large datasets using Azure Databricks, Apache Spark and PySpark
• Transform and integrate data from various sources using ETL processes

Skills

Data engineering

Azure Data Factory

Azure Databricks

Python

PySpark

SQL

Apache Spark

ETL processes

Cloud data sources

Data warehousing

Modular code

Tools

Azure Data Factory

Azure Databricks

Apache Spark

Job description

Belvedere is seeking a senior Data Engineer in Warsaw to design and maintain data ingestion pipelines for their Azure Data Marketplace platform. You will collaborate with cross-functional teams to ensure stability, scalability, and high availability across ingestion and consumption phases.

The role emphasizes hands-on development in Azure Data Factory, Databricks, PySpark, and Spark, with a focus on robust ETL processes, data integration, and production-grade software design.