Senior Data Engineer: Databricks, Delta & Azure Pipelines

Sii Poland; Rzeszów; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Great Place to Work

Profit sharing

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking a Senior Big Data Developer to build a modern data platform with Databricks and the Azure ecosystem. You will design scalable data solutions, implement and optimize ETL/ELT pipelines, and integrate data from multiple sources, including SFTP, Delta Tables, and Azure Event Hub.

You will leverage Python, PySpark, and AI-assisted development tools to enhance code quality, testing, and documentation while collaborating with cross-functional teams.

Qualifications

• 5+ years of experience in a Data Engineer, Big Data Engineer, or similar role.
• Strong hands-on experience with Python and PySpark.
• Proven experience with Databricks, Delta Tables, and modern data architectures.
• Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub.
• Experience building and maintaining scalable ETL/ELT pipelines.
• Advanced level of English.
• Interest in modern technologies and experience using AI-assisted development tools in everyday work.

Responsibilities

• Design and develop data solutions using Databricks, Python, and PySpark.
• Build and optimize ETL/ELT pipelines for batch and streaming data processing.
• Implement and maintain medallion architecture using Delta Tables.
• Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub.
• Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
• Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.

Skills

Python

PySpark

Databricks

Delta Tables

Azure Data Factory

Azure Event Hub

ETL/ELT pipelines

English

AI-assisted tools

Elasticsearch

Job description

Sii Poland is seeking a Senior Big Data Developer to build a modern data platform with Databricks and the Azure ecosystem. You will design scalable data solutions, implement and optimize ETL/ELT pipelines, and integrate data from multiple sources, including SFTP, Delta Tables, and Azure Event Hub.

You will leverage Python, PySpark, and AI-assisted development tools to enhance code quality, testing, and documentation while collaborating with cross-functional teams.