Senior Data Engineer - Databricks & Azure Data Platform

Sii Poland; Katowice; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking a Senior Big Data Developer to join our team in Katowice. You will design and build a modern data platform using Databricks and the Microsoft Azure ecosystem, focusing on scalable data solutions and reliable ETL/ELT pipelines.

You will work with Python, PySpark, Delta Tables, and Azure Data Factory, integrating data from multiple sources including SFTP files and Azure Event Hub, while applying AI-assisted development tools to improve code quality and productivity.

Qualifications

• At least 5 years of experience in Data Engineer/Big Data roles.
• Strong Python and PySpark proficiency.
• Experience with Databricks, Delta Tables, and modern data architectures.
• Practical knowledge of Microsoft Azure including Data Factory and Event Hub.
• Experience building scalable ETL/ELT pipelines.
• Advanced level of English.
• Interest in AI-assisted development tools.

Responsibilities

• Design and develop data solutions using Databricks, Python, and PySpark.
• Build and optimize ETL/ELT pipelines for batch and streaming data processing.
• Implement and maintain medallion architecture using Delta Tables.
• Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub.
• Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
• Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.

Skills

Python

PySpark

Databricks

Delta Tables

ETL/ELT pipelines

Azure Data Factory

Azure Event Hub

AI-assisted development tools

English

Tools

Elasticsearch

Job description

Sii Poland is seeking a Senior Big Data Developer to join our team in Katowice. You will design and build a modern data platform using Databricks and the Microsoft Azure ecosystem, focusing on scalable data solutions and reliable ETL/ELT pipelines.

You will work with Python, PySpark, Delta Tables, and Azure Data Factory, integrating data from multiple sources including SFTP files and Azure Event Hub, while applying AI-assisted development tools to improve code quality and productivity.