Senior Data Engineer: End-to-End Pipelines & AI SDLC

Luxoft Poland; Wrocław; On-site; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Private Medical & Dental care

Life Insurance

Internal Mobility program

Job summary

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will work on data-driven applications, build scalable pipelines, and contribute across the software lifecycle within an autonomous Agile team.

The role requires 10+ years of IT experience, strong SQL/Databricks/Python skills, and expertise in big data technologies and cloud platforms. Based in Wrocław, you will collaborate with colleagues across global locations to deliver high-throughput,

Qualifications

• Bachelor's degree in Computer Science or equivalent in IT field.
• 10+ years of experience in a similar role.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and near real-time analytics.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Cloud technologies (Azure) and Unix/Linux, shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Designing applications with high throughput and low latency for data processing.
• Automated functional testing and CI/CD pipelines.
• Ability to prototype quickly and iterate to harden the product with good engineering principles.

Responsibilities

• Design, implement, and maintain data-driven applications.
• Develop end-to-end data solutions and pipelines.
• Engineer reliable data pipelines for sourcing, processing, distributing, and storing data.
• Design data models supporting growing data volumes.
• Contribute to all stages of the software development lifecycle.
• Provide technical expertise and innovative solutions.
• Collaborate with product owner and other technologists.
• Share best practices and contribute to engineering culture.
• What is nice to have: experience with database development (SQL, PL/SQL, PostgreSQL) is desirable.

Education

Bachelor's degree in Computer Science or equivalent in IT

Tools

SQL

Databricks

Python (advanced)

Big Data

Data Warehouse

Data Lake

Spark

Delta Lake

DLT

GitLab

Azure

Unix/Linux

Shell scripting

Job description

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will work on data-driven applications, build scalable pipelines, and contribute across the software lifecycle within an autonomous Agile team.

The role requires 10+ years of IT experience, strong SQL/Databricks/Python skills, and expertise in big data technologies and cloud platforms. Based in Wrocław, you will collaborate with colleagues across global locations to deliver high-throughput,