Senior Data Engineer - Databricks & Azure Data Pipelines

Sii Poland; Szczecin; Presencial; PLN 180 000 - 260 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Great Place to Work

Internal trainings

Profit sharing

MySii app

Medical care

Open management

Resumo da oferta

Sii Poland is seeking a Senior Big Data Developer to join our team in Szczecin, Poland. You will design and build a modern data platform using Databricks and the Microsoft Azure ecosystem, focusing on scalable data solutions, ETL/ELT pipelines, and data integration from multiple sources.

You will work with Python, PySpark, Delta Tables, and Azure Data Factory to enable end-to-end data workflows, while applying AI-assisted development tools to improve code quality, testing, and documentation.

Qualificações

• At least 5 years of experience as a Data Engineer/Big Data Engineer or similar.
• Strong hands-on experience with Python and PySpark.
• Proven experience with Databricks, Delta Tables, and modern data architectures.
• Practical knowledge of Microsoft Azure including Azure Data Factory and Azure Event Hub.
• Experience building and maintaining scalable ETL/ELT pipelines.
• Advanced English language skills.
• Interest in AI-assisted development tools.

Responsabilidades

• Design and develop data solutions using Databricks, Python, and PySpark.
• Build and optimize ETL/ELT pipelines for batch and streaming data processing.
• Implement and maintain medallion architecture using Delta Tables.
• Integrate data from multiple sources including SFTP, Delta Tables, and Azure Event Hub.
• Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
• Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.

Conhecimentos

Python

PySpark

AI-assisted development tools

English proficiency

Analytical skills

Ferramentas

Databricks

Delta Tables

Azure Data Factory

Azure Event Hub

Elasticsearch

Descrição da oferta de emprego

Sii Poland is seeking a Senior Big Data Developer to join our team in Szczecin, Poland. You will design and build a modern data platform using Databricks and the Microsoft Azure ecosystem, focusing on scalable data solutions, ETL/ELT pipelines, and data integration from multiple sources.

You will work with Python, PySpark, Delta Tables, and Azure Data Factory to enable end-to-end data workflows, while applying AI-assisted development tools to improve code quality, testing, and documentation.