Cloud Data Engineer: Azure Databricks & Pipelines

Sii Poland; Katowice; On-site; PLN 150,000 - 230,000; Full time

Benefits offered by this job

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking a Data & Analytics professional to design, build, and maintain scalable data processing platforms within our Data Lake/Data Platform architecture. You will develop and optimize ETL/ELT pipelines in Azure Databricks, model data for analytics, and enable near real-time data processing.

You will collaborate with data analysts, BI, and Data Science teams, gather requirements, and document solutions while mentoring teammates and sharing best practices across the unit.

Qualifications

• 4+ years of experience in processing and integrating large data sets.
• Strong knowledge of SQL and Python.
• Experience with Spark / PySpark.
• Designing Data Lake / Data Warehouse solutions.
• Experience building ETL/ELT pipelines and using data orchestration tools.
• Hands-on with Azure cloud data processing projects (Databricks, ADF, Synapse, Fabric).
• Fluent English and Polish.
• Must be located in Poland.

Responsibilities

• Design, build, and maintain scalable data processing platforms in Data Lake / Data Platform architectures.
• Create and maintain ETL/ELT pipelines to integrate data from multiple sources in Azure Databricks.
• Model data and tailor structures for analytics and business needs.
• Implement batch and near real-time processing solutions.
• Monitor and optimize existing pipelines and workflows.
• Collaborate with data analysts, BI teams, and Data Science to provide data.
• Gather business requirements and propose optimal tech solutions.
• Create and maintain technical documentation.

Skills

SQL

Python

Apache Spark

PySpark

Tools

Azure Databricks

Azure Data Factory

Synapse

Fabric

Job description

Sii Poland is seeking a Data & Analytics professional to design, build, and maintain scalable data processing platforms within our Data Lake/Data Platform architecture. You will develop and optimize ETL/ELT pipelines in Azure Databricks, model data for analytics, and enable near real-time data processing.

You will collaborate with data analysts, BI, and Data Science teams, gather requirements, and document solutions while mentoring teammates and sharing best practices across the unit.