Senior Data Engineer: Real-Time Pipelines & AI-Driven SDLC

Luxoft Poland; Wrocław; On-site; PLN 240,000 - 420,000; Full time

Job summary

Luxoft Poland seeks a seasoned Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. You’ll design, implement, and maintain data-driven applications and build scalable pipelines to handle growing data volumes.

The role requires hands-on SQL, Databricks, and Python, plus experience with Big Data, Data Warehouse/Data Lake, Cloud (Azure), Unix/Linux, Spark, and CI/CD practices to deliver reliable, low-latency data processing.

Qualifications

• Bachelor's degree in Computer Science or equivalent in the IT field.
• 10+ years of experience in a similar role.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and real-time analytics.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Cloud technologies (Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Designing high-throughput, low-latency data processing applications.
• Building automated tests and CI/CD pipelines.

Responsibilities

• design, implement, and maintain data-driven applications
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models to support growing volumes
• contribute to all stages of the software development lifecycle
• provide technical recommendations and innovative solutions
• work with product owner and other technologists
• share expertise and best practices with the team

Skills

End-to-end development

Data pipeline design

Collaborative teamwork

Engineering culture

Education

Bachelor's degree in Computer Science or equivalent in IT

Tools

SQL

Databricks

Python (advanced)

Big Data

Data Warehouse

Data Lake

Azure

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

Job description

Luxoft Poland seeks a seasoned Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream. You’ll design, implement, and maintain data-driven applications and build scalable pipelines to handle growing data volumes.

The role requires hands-on SQL, Databricks, and Python, plus experience with Big Data, Data Warehouse/Data Lake, Cloud (Azure), Unix/Linux, Spark, and CI/CD practices to deliver reliable, low-latency data processing.