Cloud Data Engineer: Build Scalable Data Lakes on Azure

Sii Poland; Poznań; On-site; PLN 150,000 - 220,000; Full time

Benefits offered by this job

Great Place to Work

Contracts with leading brands

Centre of internal trainings

Mentoring and knowledge sharing

Medical care

Job summary

Sii Poland seeks a data engineer to join our Data & Analytics Competency Center in Poznań. You will design, build and optimize scalable data processing platforms and ETL/ELT pipelines in cloud environments.

You will work with Azure Databricks, Data Factory, Synapse and Fabric, model data for analytics, collaborate with data analysts and data science teams, and mentor junior engineers while documenting solutions.

Qualifications

• 4+ years of experience in data processing/integration projects.
• Strong SQL and Python skills.
• Experience with Spark/PySpark and data lake/warehouse design.
• Hands-on with ETL/ELT pipelines and data orchestration tools.
• Commercial experience in Azure cloud data processing (Databricks, Data Factory, Synapse, Fabric).
• Knowledge of distributed data processing concepts and pipeline optimization.
• Fluent English and Polish.

Responsibilities

• Designing and building scalable data processing platforms in Data Lake/Data Platform architectures.
• Creating and maintaining ETL/ELT pipelines to integrate data from various sources in Azure Databricks.
• Modeling data and preparing structures for analytics and business needs.
• Implementing batch and near real-time data processing solutions.
• Monitoring and optimizing existing pipelines and workflows.
• Collaborating with data analysts, BI, and Data Science teams to provide data.
• Gathering requirements and proposing optimal tech solutions.
• Creating and maintaining technical documentation.

Skills

SQL

Python

Spark / PySpark

Data modeling

ETL/ELT pipelines

Data orchestration

Distributed processing

English

Polish

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

Fabric

Job description

Sii Poland seeks a data engineer to join our Data & Analytics Competency Center in Poznań. You will design, build and optimize scalable data processing platforms and ETL/ELT pipelines in cloud environments.

You will work with Azure Databricks, Data Factory, Synapse and Fabric, model data for analytics, collaborate with data analysts and data science teams, and mentor junior engineers while documenting solutions.