Senior Data Engineer – Real-Time Pipelines & AI-Driven SDLC

Luxoft; Wrocław; On-site; PLN 240,000 - 360,000; Full time

Job summary

Luxoft in Poland is seeking an experienced data engineer to join the Regulatory Reporting team within the Investment Bank. You will design, build, and operate data-driven applications and pipelines to meet regulatory and analytics needs.

You will work in an autonomous Agile setup with global colleagues, applying CI/CD, cloud, and big data tech to deliver scalable, low-latency solutions.

Qualifications

• Bachelor's degree in Computer Science or IT with 10+ years' experience.
• Strong SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and streaming.
• Experience with AI in SDLC.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Cloud technologies (Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Designs apps with high throughput and low latency for data processing.
• Automated testing and CI/CD pipelines.
• Prototyping and iterative development.

Responsibilities

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively alongside the product owner and other technologists
• share expertise and best practices with colleagues and contribute regularly to our engineering culture

Skills

SQL

Databricks

Python

Data pipelines

Big Data

Azure

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

CI/CD

Automated testing

Prototyping

Education

Bachelor's degree in Computer Science

Tools

Databricks

GitLab

Delta Lake

DLT

Job description

Luxoft in Poland is seeking an experienced data engineer to join the Regulatory Reporting team within the Investment Bank. You will design, build, and operate data-driven applications and pipelines to meet regulatory and analytics needs.

You will work in an autonomous Agile setup with global colleagues, applying CI/CD, cloud, and big data tech to deliver scalable, low-latency solutions.