Cloud Data Engineer: Azure Data Lake & Spark Specialist

Sii Poland; Warszawa; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Great Place to Work

Profit sharing

Medical care

Centre of internal trainings

Open management

Job summary

Sii Poland in Warszawa is seeking a data engineering expert to design and optimize scalable data processing platforms in a Data Lake / Data Platform. You will build and maintain ETL/ELT pipelines using Azure Databricks and model data for analytics and business needs.

You will collaborate with data analysts, BI and Data Science teams, gather requirements, and document solutions. Fluent English and Polish are required, and you will mentor junior team members in a dynamic center.

Qualifications

• Min 4 years’ experience in data processing and integration projects.
• Strong SQL and Python skills.
• Experience with Spark / PySpark.
• Experience designing Data Lake and Data Warehouse solutions.
• Experience building ETL/ELT pipelines and data orchestration tools.
• Fluent English and Polish language required.

Responsibilities

• Design, build, and optimize scalable data processing platforms in Data Lake / Data Platform architecture.
• Create and maintain ETL/ELT pipelines to integrate data using Azure Databricks.
• Model data and structure datasets for analytics and business needs.
• Implement batch and near real-time data processing solutions.
• Monitor, optimize, and develop existing pipelines and workflows.
• Collaborate with data analysts, BI and Data Science teams to provide data.
• Gather business requirements and propose optimal technological solutions.
• Create and maintain technical documentation for developed solutions.
• Support and mentor less experienced team members, sharing knowledge.

Skills

SQL

Python

Apache Spark / PySpark

Azure Databricks

Data Lake / Data Warehouse

ETL/ELT pipelines

Data modeling

Distributed environments

English communication

Polish language

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

Fabric

Job description

Sii Poland in Warszawa is seeking a data engineering expert to design and optimize scalable data processing platforms in a Data Lake / Data Platform. You will build and maintain ETL/ELT pipelines using Azure Databricks and model data for analytics and business needs.

You will collaborate with data analysts, BI and Data Science teams, gather requirements, and document solutions. Fluent English and Polish are required, and you will mentor junior team members in a dynamic center.