Senior Cloud Data Engineer - Azure Data Lake & Spark

Sii Poland; Lublin; On-site; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking a data processing specialist to join our Data & Analytics Competence Center. You will design and implement scalable data processing platforms in Data Lake / Data Platform architectures, focusing on performance and reliability.

You will create and maintain ETL/ELT pipelines in Azure Databricks, model data for analytics, and collaborate with Data Analysts, BI teams and Data Scientists to meet business needs.

Qualifications

• Minimum 4 years of experience in data processing and integration projects.
• Strong SQL and Python skills.
• Experience with Apache Spark / PySpark.
• Experience designing Data Lake and Data Warehouse solutions.
• Proficient in building ETL/ELT pipelines and data orchestration tools.
• Cloud-based Microsoft Azure data processing projects (Databricks, ADF, Synapse, Fabric).
• Knowledge of distributed data processing concepts and pipeline optimization.
• Fluent in English.
• Polish language fluency.
• Willing to be located in Poland.

Responsibilities

• Design, build, and scale data processing platforms in Data Lake / Data Platform architectures.
• Create and maintain ETL/ELT pipelines for data integration in Azure Databricks.
• Model data for analytics and business needs.
• Implement batch and/or near real-time data processing solutions.
• Monitor, optimize, and improve existing data pipelines and processes.
• Collaborate with data analysts, BI teams, and Data Scientists on data prep and sharing.
• Gather business requirements and propose optimal technical solutions.
• Create and maintain technical documentation for developed solutions.
• Mentor and share knowledge with junior team members.

Skills

SQL

Python

Spark / PySpark

Data Lake

Data Warehouse

ETL/ELT

Azure Databricks

Azure Data Factory

Synapse

Fabric

Distributed processing

English

Polish

Tools

Azure Databricks

Job description

Sii Poland is seeking a data processing specialist to join our Data & Analytics Competence Center. You will design and implement scalable data processing platforms in Data Lake / Data Platform architectures, focusing on performance and reliability.

You will create and maintain ETL/ELT pipelines in Azure Databricks, model data for analytics, and collaborate with Data Analysts, BI teams and Data Scientists to meet business needs.