Azure Data Engineer: Data Lake, ETL/ELT & Spark Pipelines

Sii Poland; Warszawa; On-site; PLN 140,000 - 190,000; Full time

Benefits offered by this job

Great Place to Work

Contracts with the biggest brands

Center of internal trainings

Profit sharing

Medical care

Job summary

Sii Poland invites experienced data engineers to join a focused Data & Analytics unit specializing in data processing, data science, and ML. You will design scalable data platforms, build ETL/ELT pipelines in Azure Databricks, and collaborate with analysts and data scientists to optimize data solutions.

Ideal candidates have 4+ years in large-scale data projects, strong SQL/Python skills, and hands-on Azure data services experience.

Qualifications

• Minimum 4 years of experience in projects related to processing and integrating large volumes of data.
• Strong knowledge of SQL and Python.
• Experience with data processing frameworks such as Apache Spark / PySpark.
• Practical experience in designing and building Data Lake and Data Warehouse solutions.
• Ability to build and maintain ETL/ELT pipelines and work with data orchestration and integration tools.
• Commercial experience in cloud-based Microsoft Azure data processing projects (Databricks, Data Factory, Synapse, Fabric).
• Knowledge of data processing concepts in a distributed environment and optimizing data pipelines.
• Ability to communicate fluently in English.
• Fluent knowledge of Polish is required.
• Located in Poland.

Responsibilities

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture.
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment.
• Data modeling and preparing data structures tailored to analytical and business needs.
• Implementing solutions for data processing (batch and/or near real-time).
• Monitoring, optimizing, and developing existing pipelines and data processing processes.
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing.
• Gathering business requirements and proposing optimal technological solutions.
• Creating and maintaining technical documentation for developed solutions.
• Supporting and mentoring less experienced team members, sharing knowledge and best practices.

Skills

SQL

Python

Data modeling

ETL/ELT pipelines

Distributed data processing concepts

English communication

Polish language

Tools

Azure Databricks

Azure Data Factory

Synapse

Fabric

Apache Spark / PySpark

Job description

Sii Poland invites experienced data engineers to join a focused Data & Analytics unit specializing in data processing, data science, and ML. You will design scalable data platforms, build ETL/ELT pipelines in Azure Databricks, and collaborate with analysts and data scientists to optimize data solutions.

Ideal candidates have 4+ years in large-scale data projects, strong SQL/Python skills, and hands-on Azure data services experience.