Senior Data Engineer - Databricks & Azure ETL Expert

Sii Poland; Białystok; On-site; PLN 260,000 - 380,000; Full time

Benefits offered by this job

Profit sharing

Great Place to Work

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Medical care

Job summary

Sii Poland is seeking a Senior Big Data Developer to join our team, building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design scalable data solutions and optimize ETL/ELT pipelines across diverse data sources.

Implement medallion architecture with Delta Tables and collaborate on end-to-end data workflows using Azure Data Factory. AI-assisted development tools will help improve code quality and productivity.

Qualifications

• 5+ years in Data Engineer/Big Data roles.
• Strong Python and PySpark skills.
• Hands-on with Databricks and Delta Tables.
• Experience in Azure Data Factory and Event Hub.
• Proven ability to build scalable ETL/ELT pipelines.
• Advanced English proficiency.
• Interest in AI-assisted development tools.

Responsibilities

• Design and develop data solutions using Databricks, Python, and PySpark.
• Build and optimize ETL/ELT pipelines for batch and streaming data.
• Implement medallion architecture using Delta Tables.
• Integrate data from multiple sources including SFTP, Delta Tables, and Azure Event Hub.
• Collaborate with Azure Data Factory to support end-to-end data workflows.
• Leverage AI-powered tools to improve code quality, testing, and productivity.

Skills

Python

PySpark

Databricks

Delta Tables

ETL/ELT pipelines

AI-assisted development tools

Tools

Azure Data Factory

Azure Event Hub

Job description

Sii Poland is seeking a Senior Big Data Developer to join our team, building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design scalable data solutions and optimize ETL/ELT pipelines across diverse data sources.

Implement medallion architecture with Delta Tables and collaborate on end-to-end data workflows using Azure Data Factory. AI-assisted development tools will help improve code quality and productivity.