Senior Data Engineer - financial industry (f/m/x)

Sii Poland

Wrocław

On-site

PLN 180,000 - 260,000

Full time

2 days ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Great Place to Work

Profit sharing

Centre of internal trainings

MySii app

Medical care

Regular integration events

Job summary

Sii Poland is looking for a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design and develop scalable data solutions, implement and optimize ETL/ELT pipelines, and integrate data from multiple sources.

The role requires 5+ years in data engineering, strong Python/PySpark skills, Databricks experience, and fluent English.

Qualifications

At least 5 years of experience in a Data Engineer, Big Data Engineer, or similar role.
Strong hands-on experience with Python and PySpark.
Proven experience with Databricks, Delta Tables, and modern data architectures.
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub.
Experience building and maintaining scalable ETL/ELT pipelines.
Advanced level of English.
Interest in modern technologies and AI-assisted development tools.

Responsibilities

Design and develop data solutions using Databricks, Python, and PySpark.
Build and optimize ETL/ELT pipelines for batch and streaming data processing.
Implement and maintain medallion architecture using Delta Tables.
Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub.
Work with Azure services such as Azure Data Factory to support end-to-end data workflows.
Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity.

Skills

Python

PySpark

Databricks

Delta Tables

Azure Data Factory

Azure Event Hub

ETL/ELT pipelines

AI-assisted development tools

English

Tools

Elasticsearch

Job description

We are looking for a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. In this role, you will be responsible for designing and developing scalable data solutions, implementing and optimizing ETL/ELT pipelines, and integrating data from multiple sources.

Your tasks

Design and develop data solutions using Databricks, Python, and PySpark
Build and optimize ETL/ELT pipelines for batch and streaming data processing
Implement and maintain medallion architecture using Delta Tables
Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub
Work with Azure services such as Azure Data Factory to support end-to-end data workflows
Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity

Requirements

At least 5 years of experience in a Data Engineer, Big Data Engineer, or similar role
Strong hands-on experience with Python and PySpark
Proven experience with Databricks, Delta Tables, and modern data architectures
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub
Experience building and maintaining scalable ETL/ELT pipelines
Advanced level of English
Interest in modern technologies and experience using AI-assisted development tools in everyday work

Nice to have

Familiarity with Elasticsearch
Strong analytical skills and a proactive approach to solving complex data-related challenges

Sii ensures that all hiring decisions are made solely on the basis of qualifications and competence. We are committed to equal and fair treatment of all, regardless of legally protected characteristics. At Sii, we promote a diverse and inclusive work environment, in full compliance with applicable anti-discrimination laws.

Benefits For You