Cloud Data Engineer (f/m/x)

Sii Poland; Kielce; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Great Place to Work

Profit sharing

Medical care

Centre of internal trainings

Many experts to learn from

Open management

Job summary

Sii Poland is seeking a data engineer to design, build, and scale data processing platforms in Data Lake and Data Platform architectures.

You will create and maintain ETL/ELT pipelines in Azure Databricks, model data for analytics, and implement batch and near real-time processing. Collaboration with analysts and Data Science is essential.

Qualifications

• Minimum 4 years of experience in data processing and integration projects.
• Strong knowledge of SQL and Python.
• Experience with Spark/PySpark and Data Lake/Data Warehouse design.
• Hands-on in building ETL/ELT pipelines and data orchestration.
• Experience with Azure data services (Databricks, Data Factory, Synapse, Fabric).
• Fluent English and Polish language skills are required.

Responsibilities

• Design, build, and scale data processing platforms in Data Lake / Data Platform architecture.
• Create and maintain ETL/ELT pipelines for data integration and processing in Azure Databricks.
• Model data and tailor structures for analytical needs.
• Implement batch and near real-time data processing solutions.
• Monitor and optimize existing pipelines and data processes.
• Collaborate with data analysts, BI teams, and Data Science on data prep and sharing.
• Gather business requirements and propose optimal tech solutions.
• Create and maintain technical documentation for solutions.
• Mentor less experienced team members and share best practices.

Skills

SQL

Python

Apache Spark

PySpark

Data Lake

Data Warehouse

ETL/ELT pipelines

Azure Databricks

Azure Data Factory

Azure Synapse

Fabric

Distributed processing

English

Polish

Tools

Databricks

Azure Data Factory

Synapse

Fabric

Job description

Do you want to develop your skills in cloud technologies? Join our specialized unit focusing on experts in data processing and analysis within the Data & Analytics Competence Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.

Your tasks

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions
• Supporting and mentoring less experienced team members, sharing knowledge and best practices

Requirements

• Minimum 4 years of experience in projects related to processing and integrating large volumes of data
• Strong knowledge of SQL and Python
• Experience working with data processing frameworks such as Apache Spark / PySpark
• Practical experience in designing and building Data Lake and Data Warehouse solutions
• Ability to build and maintain ETL/ELT pipelines and work with data orchestration and integration tools
• Commercial experience in cloud-based Microsoft Azure data processing projects (e.g., Databricks, Azure Data Factory, Synapse, Fabric)
• Knowledge of data processing concepts in a distributed environment and optimizing data pipelines
• Ability to communicate fluently in English
• Fluent knowledge of Polish is required
• Required to be located in Poland

Nice to have

• Experience in projects related to data migration from on-premise to cloud (databases: Oracle, PostgreSQL, MS SQL)

Job no. JOB-XWELK

Sii ensures that all hiring decisions are made solely on the basis of qualifications and competence. We are committed to equal and fair treatment of all, regardless of legally protected characteristics. At Sii, we promote a diverse and inclusive work environment, in full compliance with applicable anti-discrimination laws.

Benefits For You

• Great Place to Work
• Solid financial situation
• Contracts with the biggest brands
• Centre of internal trainings
• Many experts you can learn from
• Open and accessible management team
• Profit sharing
• Passion Sponsorship program
• Regular integration events and trips
• Comfortable and well-equipped offices
• MySii app
• Medical care