Senior Data Engineer - Databricks, Python and SQL | Hybrid

Luxoft; Wrocław; Hybrid; PLN 250,000 - 360,000; Full time

Benefits offered by this job

MyBenefit program (sports card, well‑b

LuxTalent platform

Internal Mobility program

Job summary

Luxoft in Poland seeks an experienced data engineer to join the Regulatory Reporting team within the Investment Bank domain. You will design and implement data-driven applications, build scalable batch and streaming pipelines, and work across the full software development lifecycle with a focus on performance and reliability.

The role requires 8+ years of IT experience, strong Python/SQL, PySpark, Databricks (Delta Lake/Delta Live Tables), Azure, Unix/Linux, shell scripting, CI/CD, and Power BI.

Qualifications

• Bachelor's degree in Computer Science or related IT field
• 8+ years of experience in a similar role
• Advanced proficiency in Python and SQL
• Hands-on experience with PySpark for near real-time analytics
• Experience with Databricks including Delta Lake/Delta Live Tables
• Experience designing Data Lake/Lakehouse and Data Warehouse solutions
• Experience with Azure cloud services, Unix/Linux, and shell scripting
• Expertise in automated testing and CI/CD pipelines (GitLab CI)
• Hands-on experience with Power BI
• Experience with AI tools in the SDLC

Responsibilities

• Design, implement, and maintain data-driven applications
• Develop and see through end-to-end solutions
• Engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• Design data models that support growing volumes
• Contribute to all stages of the software development lifecycle
• Provide technical expertise, recommendations, and innovative solutions
• Collaborate with product owner and other engineers
• Share expertise and best practices within the team

Skills

Python

SQL

PySpark

Data pipelines

Data modeling

Azure

Unix/Linux

Shell scripting

CI/CD

GitLab CI

AI tools in SDLC

Education

Bachelor's degree in Computer Science or related IT field

Tools

Databricks

Delta Lake

Delta Live Tables

Spark SQL

Structured Streaming

Job description

Luxoft in Poland seeks an experienced data engineer to join the Regulatory Reporting team within the Investment Bank domain. You will design and implement data-driven applications, build scalable batch and streaming pipelines, and work across the full software development lifecycle with a focus on performance and reliability.

The role requires 8+ years of IT experience, strong Python/SQL, PySpark, Databricks (Delta Lake/Delta Live Tables), Azure, Unix/Linux, shell scripting, CI/CD, and Power BI.