Cloud Data Engineer: Azure Data Lake & Pipelines Specialist

Sii Poland; Kielce; On-site; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Great Place to Work

Profit sharing

Open management team

Medical care

Job summary

Sii Poland is seeking an experienced Data Engineer to design and build scalable data processing platforms in Data Lake and Data Platform architectures. You will create and maintain ETL/ELT pipelines in Azure Databricks, model data, and support data teams with optimized pipelines and documentation.

You will collaborate with analysts, BI, and Data Science teams, translating business requirements into robust data solutions while mentoring junior colleagues.

Qualifications

• Minimum 4 years of experience with processing and integrating large volumes of data.
• Strong knowledge of SQL and Python.
• Experience with data processing frameworks such as Apache Spark / PySpark.
• Practical experience in designing and building Data Lake and Data Warehouse solutions.
• Ability to build and maintain ETL/ELT pipelines and work with data orchestration and integration tools.
• Commercial experience in cloud-based Microsoft Azure data processing projects (e.g., Databricks, Azure Data Factory, Synapse, Fabric).
• Knowledge of data processing concepts in a distributed environment and optimizing data pipelines.

Responsibilities

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture.
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment.
• Data modeling and preparing data structures tailored to analytical and business needs.
• Implementing solutions for data processing (batch and/or near real-time).
• Monitoring, optimizing, and developing existing pipelines and data processing processes.
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing.
• Gathering business requirements and proposing optimal technological solutions.
• Creating and maintaining technical documentation for developed solutions.
• Supporting and mentoring less experienced team members, sharing knowledge and best practices.

Skills

SQL

Python

English

Polish

Tools

Apache Spark

PySpark

Azure Databricks

Azure Data Factory

Synapse

Fabric

Job description

Sii Poland is seeking an experienced Data Engineer to design and build scalable data processing platforms in Data Lake and Data Platform architectures. You will create and maintain ETL/ELT pipelines in Azure Databricks, model data, and support data teams with optimized pipelines and documentation.

You will collaborate with analysts, BI, and Data Science teams, translating business requirements into robust data solutions while mentoring junior colleagues.