Senior Data Engineer: Scalable Pipelines & AI-Driven SDLC

Luxoft Poland; Wrocław; On-site; PLN 260,000 - 420,000; Full time

Job summary

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will design, implement, and maintain data-driven applications, build scalable data pipelines for batch and near real-time analytics, and contribute across the full SDLC in an Agile, cross-functional environment.

You will collaborate with product owners and engineers to ensure high throughput, low latency solutions, and apply best practices in automation, testing, and CI/CD within cloud-based data

Qualifications

• Bachelor's degree in Computer Science or equivalent with 10+ years of relevant experience.
• Hands-on SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and near real-time analytics.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Experience with Cloud technologies (e.g., Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Extensive experience designing applications with high throughput and low latency for data processing.
• Expertise in building automated functional testing and CI/CD pipelines using industry-standard tools.

Responsibilities

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end.
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively alongside the product owner and other technologists
• share expertise and best practices with colleagues and contribute regularly to our engineering culture

Skills

SQL

Databricks

Python

Big Data

Data Warehouse

Data Lake

Azure

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

CI/CD pipelines

Education

Bachelor's degree in Computer Science

Tools

GitLab

CI/CD

Delta Lake

Spark

DLT

Job description

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will design, implement, and maintain data-driven applications, build scalable data pipelines for batch and near real-time analytics, and contribute across the full SDLC in an Agile, cross-functional environment.

You will collaborate with product owners and engineers to ensure high throughput, low latency solutions, and apply best practices in automation, testing, and CI/CD within cloud-based data