Cloud Data Engineer (f/m/x)

Sii Poland; Częstochowa; On-site; PLN 120,000 - 160,000; Full time

Job summary

Sii Poland is seeking a data engineering specialist to design and build scalable data processing platforms within a Data & Analytics unit. You will develop ETL/ELT pipelines for data integration, model data for analytics, and implement batch and near real-time processing in Azure Databricks.

You will collaborate with data analysts, BI teams and Data Science to prepare and share data, gather requirements, and document solutions.

Qualifications

• Experience designing and building scalable data processing platforms.
• Strong data modeling and data integration skills.
• Ability to collaborate with data analysts, BI teams and Data Science.

Responsibilities

• Design, build and scale data processing platforms in Data Lake/Data Platform architecture.
• Create and maintain ETL/ELT pipelines for data integration in Azure Databricks.
• Model data and tailor structures for analytical/business needs.
• Implement batch and near real-time data processing solutions.
• Monitor, optimize and develop existing pipelines and processing.
• Collaborate with analysts, BI, and Data Science on data prep and sharing.
• Gather business requirements and propose optimal tech solutions.
• Create and maintain technical documentation for solutions.

Skills

ETL/ELT pipelines

Data modeling

Data processing

Collaboration with teams

Documentation

Tools

Azure Databricks

Data Lake / Data Platform

Job description

Do you want to develop your skills in cloud technologies? Join our specialized unit focusing on experts in data processing and analysis within the Data & Analytics Competence Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.

Your tasks

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions