Cloud Data Engineer (f/m/x)

Sii Poland; Katowice; On-site; PLN 134,000 - 201,000; Full time

Job summary

Sii Poland is expanding its Data & Analytics Competence Center in Katowice to develop scalable data processing platforms and ETL/ELT pipelines within Azure Databricks. The role focuses on data modeling, batch and real-time processing, and ensuring robust data pipelines in collaboration with BI and Data Science teams.

You will document solutions and translate business requirements into technical architectures, supporting analytics-driven decision-making across the organization.

Qualifications

• Experience designing scalable data processing platforms.
• Proficient in building ETL/ELT pipelines for data integration.
• Experience with Azure Databricks.
• Strong data modeling and data structure design.
• Experience with batch and near real-time data processing.
• Ability to monitor and optimize data pipelines.
• Excellent collaboration with data analysts and BI teams.
• Ability to gather requirements and propose solutions.
• Create and maintain technical documentation.

Responsibilities

• Design, build, and deploy scalable data processing platforms.
• Create and maintain ETL/ELT pipelines for Azure Databricks.
• Model data and tailor structures for analytics.
• Implement batch and near real-time processing solutions.
• Monitor and optimize existing pipelines.
• Collaborate with data analysts, BI teams, and Data Science.
• Gather business requirements and propose solutions.
• Create and maintain technical documentation.

Skills

Data engineering

ETL/ELT pipelines

Azure Databricks

Data modeling

Data Lake

Batch processing

Real-time processing

Monitoring pipelines

BI collaboration

Technical documentation

Job description

Do you want to develop your skills in cloud technologies? Join our specialized unit focusing on experts in data processing and analysis within the Data & Analytics Competence Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.

Your tasks

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions