Senior Data Engineer: Databricks, Python & SQL Pipelines

Luxoft Poland; Wrocław; On-site; PLN 210,000 - 270,000; Full time

Benefits offered by this job

Tax-deductible costs on a contract of

Private Medical & Dental care & Life

Job summary

You’ll be working in the Regulatory Reporting team in Poland, in the Investment Bank within the Digital Operations Stream. This role focuses on transforming data-driven processes to meet regulatory obligations while delivering value from data assets.

Our small, autonomous Agile teams respond to client demands and continuously improve delivery. You will join a diverse team with opportunities for rotation across projects and locations, contributing to engineering culture and best practices.

Qualifications

• Bachelor's degree in Computer Science or equivalent in IT with 10+ years of experience in a similar role.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and streaming analytics.
• Experience using AI in engineering SDLC.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Experience with Cloud technologies (Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Designing high throughput and low latency data processing apps.
• Experience building automated testing and CI/CD pipelines.
• Ability to prototype quickly and iterate with engineering best practices.

Responsibilities

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end.
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively alongside the product owner and other technologists
• share expertise and best practices with colleagues and contribute regularly to our engineering culture

Skills

SQL

Databricks

Python

Big Data

Data Warehouse

Data Lake

Azure

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

CI/CD

Testing automation

Prototyping

Education

Bachelor's degree in Computer Science or equivalent IT field

Tools

GitLab

Job description

You’ll be working in the Regulatory Reporting team in Poland, in the Investment Bank within the Digital Operations Stream. This role focuses on transforming data-driven processes to meet regulatory obligations while delivering value from data assets.

Our small, autonomous Agile teams respond to client demands and continuously improve delivery. You will join a diverse team with opportunities for rotation across projects and locations, contributing to engineering culture and best practices.