Cloud Data Engineer (f/m/x)

Sii Poland; Kraków; On-site; PLN 140,000 - 230,000; Full time

Job summary

Sii Poland is expanding its Data & Analytics Competence Center and invites a data engineer to design and optimize scalable data processing platforms. You will build ETL/ELT pipelines in Azure Databricks, model data for analytics, and work on batch and near real-time processing projects.

The role emphasizes collaboration with data analysts, BI teams, and Data Science, plus documentation and requirements gathering to enable effective data solutions.

Qualifications

• Experience designing and building data processing platforms.
• Experience implementing ETL/ELT pipelines with Azure Databricks.
• Strong data modeling for analytical/business needs.
• Familiarity with batch and near real-time processing architectures.
• Ability to monitor, optimize, and document data pipelines.

Responsibilities

• Designing, building, and expanding scalable data platforms in Data Lake architecture.
• Creating and maintaining ETL/ELT pipelines for data from various sources in Azure Databricks.
• Modeling data and structuring data for analytical and business use.
• Implementing batch and near real-time data processing solutions.
• Monitoring, tuning, and improving existing pipelines and processes.
• Collaborating with data analysts, BI teams, and Data Science for data prep and sharing.
• Gathering business requirements and proposing optimal technology solutions.
• Creating and maintaining technical documentation for developed solutions.

Skills

Data engineering

Azure Databricks

ETL/ELT design

Data modeling

Data Lake architecture

Education

BSc in Computer Science or related field

Tools

Azure Data Factory

SQL

Databricks

Job description

Do you want to develop your skills in cloud technologies? Join our specialized unit focusing on experts in data processing and analysis within the Data & Analytics Competence Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.

Your tasks

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions