Senior Data Engineer

Luxoft Poland; Wrocław; On-site; PLN 260,000 - 420,000; Full time

Job summary

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will design, implement, and maintain data-driven applications, build scalable data pipelines for batch and near real-time analytics, and contribute across the full SDLC in an Agile, cross-functional environment.

You will collaborate with product owners and engineers to ensure high throughput, low latency solutions, and apply best practices in automation, testing, and CI/CD within cloud-based data

Qualifications

• Bachelor's degree in Computer Science or equivalent with 10+ years of relevant experience.
• Hands-on SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and near real-time analytics.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Experience with Cloud technologies (e.g., Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab.
• Extensive experience designing applications with high throughput and low latency for data processing.
• Expertise in building automated functional testing and CI/CD pipelines using industry-standard tools.

Responsibilities

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end.
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively alongside the product owner and other technologists
• share expertise and best practices with colleagues and contribute regularly to our engineering culture

Skills

SQL

Databricks

Python

Big Data

Data Warehouse

Data Lake

Azure

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

CI/CD pipelines

Education

Bachelor's degree in Computer Science

Tools

GitLab

CI/CD

Delta Lake

Spark

DLT

Job description

You'll be working in the Regulatory Reporting team in Poland, in the Investment Bank within the Digital Operations Stream. Our purpose is to transform the way client does business by simplifying and improving the products and platforms relied on by our Regulatory and Data Clients. We play a crucial role in enabling the Investment Bank to meet its regulatory obligations and create value from its wealth of data. We develop and implement the most innovative technologies available within client in our solutions and products.

Our small, autonomous Agile teams are empowered to respond to client demands while challenging the ways of working to improve our delivery experience. With members based in London, New York, Singapore, Zurich, Poland, and India, we pride ourselves on being an inclusive and diverse team. We are looking for experts keen to keep learning and changing the game with us. Diversity helps us grow together. That's why we are committed to fostering and advancing diversity, equity, and inclusion. It strengthens our business and brings value to our clients.

Responsibilities:

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end.
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively alongside the product owner and other technologists
• share expertise and best practices with colleagues and contribute regularly to our engineering culture

Mandatory Skills Description:

• Bachelor's degree in Computer Science or equivalent in the IT field with 10+ years of experience in a similar role
• Hands-on experience with SQL, Databricks, Python (advanced)
• Hands-on experience building scalable data pipelines, processing high-volume data in batch as well as stream for near real-time analytics
• Hands-on usage of AI in engineering SDLC.
• Experience with Big Data, Data Warehouse, and Data Lake
• Experience with Cloud technologies (e.g., Azure), Unix/Linux, and shell scripting
• Experience with Spark, Delta Lake, DLT, GitLab
• Extensive experience designing applications, specifically considering the NFRs around high throughput and low latency for data processing
• Expertise in building automated functional testing and CI/CD pipelines using industry-standard tools
• Ability to quickly implement prototypes and iterate to harden the product with good engineering principles