Senior Data Engineer: Databricks on Azure + AI Tools

Sii Poland

Poznań

On-site

PLN 230,000 - 320,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Great Place to Work

Centre of internal trainings

Profit sharing

Medical care

Open and accessible management team

Job summary

Sii Poland is seeking a Senior Big Data Developer to join our team in Poznań to build a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design and develop scalable data solutions, implement and optimize ETL/ELT pipelines, and integrate data from multiple sources, including SFTP files and Azure Event Hub.

The role emphasizes AI-assisted development, testing, and documentation to deliver impactful data solutions.

Qualifications

5+ years of experience as a Data Engineer or similar role.
Strong hands-on experience with Python and PySpark.
Proven experience with Databricks, Delta Tables, and modern data architectures.
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub.
Experience building and maintaining scalable ETL/ELT pipelines.
Advanced English proficiency.
Interest in modern technologies and AI-assisted development tools.

Responsibilities

Design and develop data solutions using Databricks, Python, and PySpark.
Build and optimize ETL/ELT pipelines for batch and streaming data processing.
Implement and maintain medallion architecture using Delta Tables.
Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub.
Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.