Senior Data Engineer: Databricks, Azure & AI-Powered Pipelines

Sii Poland; Wrocław; In loco; PLN 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Descrizione del lavoro

Sii Poland is seeking a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design scalable data solutions, develop ETL/ELT pipelines, and integrate data from multiple sources to enable AI-assisted development and impactful analytics.

In this role you will work hands-on with Python, PySpark, Delta Tables, and Azure Data Factory, collaborating with cross-functional teams in a dynamic, inclusive environment in

Competenze

• Minimum 5 years of experience in data engineering or big data roles.
• Strong hands-on experience with Python and PySpark.
• Proven experience with Databricks and Delta Tables.
• Experience with Azure data services and building scalable ETL/ELT pipelines.

Mansioni

• Design and develop data solutions using Databricks, Python, and PySpark
• Build and optimize ETL/ELT pipelines for batch and streaming data processing
• Implement and maintain medallion architecture using Delta Tables
• Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub
• Work with Azure services such as Azure Data Factory to support end-to-end data workflows
• Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity

Conoscenze

Databricks

Python

PySpark

Delta Tables

Azure Data Factory

Azure Event Hub

ETL/ELT pipelines

English (Advanced)

AI-assisted development

Strumenti

Delta Lake

Elasticsearch

Descrizione del lavoro

Sii Poland is seeking a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design scalable data solutions, develop ETL/ELT pipelines, and integrate data from multiple sources to enable AI-assisted development and impactful analytics.

In this role you will work hands-on with Python, PySpark, Delta Tables, and Azure Data Factory, collaborating with cross-functional teams in a dynamic, inclusive environment in