Cloud Data Engineer: Azure Data Lake & Pipelines

Sii Poland; Białystok; On-site; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Great Place to Work

Profit sharing

Medical care

Centre of internal trainings

Open management team

Job summary

Sii Poland is seeking an experienced data processing specialist to join our Data & Analytics Competence Center to develop skilled data processing and analytics capabilities. You will design scalable data platforms in Data Lake/Data Platform architectures and collaborate with analysts, BI teams, and Data Science on data preparation and sharing.

Responsibilities include building ETL/ELT pipelines in Azure Databricks, data modeling, and implementing batch or near real-time processing, while

Qualifications

• >4 years of experience in processing and integrating large data volumes.
• Experience with SQL and Python.
• Experience with Spark/PySpark.
• Designing Data Lake/Data Warehouse solutions.
• ETL/ELT pipeline development and data orchestration.
• Cloud-based Azure data processing projects (Databricks, Data Factory, Synapse, Fabric).
• Knowledge of distributed data processing and pipeline optimization.
• Fluent in English; Polish language proficiency required.
• Location in Poland.

Responsibilities

• Design, build, and scale data processing platforms in Data Lake/ Data Platform architectures.
• Create and maintain ETL/ELT pipelines for data integration from diverse sources in Azure Databricks.
• Model data and tailor structures for analytical and business needs.
• Implement batch and near real-time data processing solutions.
• Monitor, optimize, and improve existing pipelines.
• Collaborate with data analysts, BI teams, and Data Science on data preparation and sharing.
• Gather business requirements and propose optimal tech solutions.
• Create and maintain technical documentation.
• Mentor and share knowledge with junior team members.

Skills

SQL

Python

Apache Spark

PySpark

Data Lake/Data Warehouse

ETL/ELT pipelines

Azure Databricks

Azure Data Factory

Synapse

Fabric

Data modeling

Data processing concepts

Tools

Azure Databricks

Azure Data Factory

Synapse

Fabric

Job description

Sii Poland is seeking an experienced data processing specialist to join our Data & Analytics Competence Center to develop skilled data processing and analytics capabilities. You will design scalable data platforms in Data Lake/Data Platform architectures and collaborate with analysts, BI teams, and Data Science on data preparation and sharing.

Responsibilities include building ETL/ELT pipelines in Azure Databricks, data modeling, and implementing batch or near real-time processing, while