Senior Data Engineer: Databricks, Python & SQL Specialist

Luxoft Poland; Wrocław; On-site; PLN 240,000 - 360,000; Full time

Job summary

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will design and maintain data-driven applications and build end-to-end data pipelines for high-volume analytics.

This role requires 10+ years in IT, advanced Python, SQL, Databricks, Spark, and Azure cloud experience, with strong focus on performance and low latency data processing. You will collaborate with product owners and other engineers across Agile teams.

Qualifications

• Bachelor's degree in Computer Science or equivalent IT field with 10+ years experience.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Build scalable data pipelines for batch and near real-time analytics.
• Experience with Big Data, Data Warehouse, and Data Lake.
• Cloud technologies (Azure), Unix/Linux, and shell scripting.
• Experience with Spark, Delta Lake, DLT, GitLab; focus on high throughput and low latency.
• Automation of testing and CI/CD pipelines; prototyping to production.
• Ability to deliver end-to-end solutions with strong engineering principles.

Responsibilities

• design, implement, and maintain data-driven applications
• develop and see through end-to-end solutions
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models to support growing volumes
• contribute to all stages of the SDLC
• provide technical recommendations and innovative solutions
• collaborate with product owner and other engineers
• share expertise and contribute to engineering culture

Skills

SQL

Python

Data pipelines

CI/CD

Cloud - Azure

Big Data

Unix/Linux

Shell scripting

Education

Bachelor's degree in Computer Science / IT

Tools

Databricks

Spark

Delta Lake

DLT

GitLab

Job description

Luxoft Poland is seeking a senior data engineer to join the Regulatory Reporting team in Poland. You will design and maintain data-driven applications and build end-to-end data pipelines for high-volume analytics.

This role requires 10+ years in IT, advanced Python, SQL, Databricks, Spark, and Azure cloud experience, with strong focus on performance and low latency data processing. You will collaborate with product owners and other engineers across Agile teams.