Senior Data Engineer - Databricks, Azure & AI Pipelines

Sii Poland; Województwo mazowieckie; On-site; PLN 200,000 - 320,000; Full time

Benefits offered by this job

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking a Senior Big Data Developer to join our team in Poland. You will design and build a modern data platform using Databricks and the Azure ecosystem, developing scalable ETL/ELT pipelines and implementing medallion architecture with Delta Tables.

You will integrate data from multiple sources, including SFTP files and Azure Event Hub, collaborate with Azure Data Factory, and rely on AI-powered tools to improve code quality, testing, and productivity.

Qualifications

• 5+ years in data engineering or a similar role.
• Strong Python and PySpark hands-on experience.
• Experience with Databricks, Delta Tables, and modern data architectures.
• Azure ecosystem knowledge including Data Factory and Event Hub.
• Experience building scalable ETL/ELT pipelines.
• Advanced English.

Responsibilities

• Design and develop data solutions using Databricks, Python, and PySpark.
• Build and optimize ETL/ELT pipelines for batch and streaming data processing.
• Implement and maintain medallion architecture using Delta Tables.
• Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub.
• Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
• Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.

Skills

Python

PySpark

Databricks

Delta Tables

Azure

ETL/ELT

English (Advanced)

AI-assisted tools

Tools

Azure Data Factory

Azure Event Hub

Job description

Sii Poland is seeking a Senior Big Data Developer to join our team in Poland. You will design and build a modern data platform using Databricks and the Azure ecosystem, developing scalable ETL/ELT pipelines and implementing medallion architecture with Delta Tables.

You will integrate data from multiple sources, including SFTP files and Azure Event Hub, collaborate with Azure Data Factory, and rely on AI-powered tools to improve code quality, testing, and productivity.