Senior Data Engineer - Real-Time Data Pipelines & AI SDLC

Luxoft; Wrocław; On-site; PLN 250,000 - 380,000; Full time

Job summary

Luxoft is seeking a senior data engineering professional to design and maintain data-driven applications in Poland. You will build scalable data pipelines for high-volume batch and streaming data, with end-to-end ownership and collaboration across product and engineering teams.

The role requires extensive experience with SQL, Python, Databricks, Spark, Delta Lake, and cloud technologies, ensuring high throughput and low latency analytics.

Qualifications

• Bachelor's degree in Computer Science or equivalent in IT field with 10+ years of experience in a similar role.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and streaming near real-time analytics.
• Experience with AI in engineering SDLC.

Responsibilities

• design, implement, and maintain new and existing data-driven applications
• ability to develop and see through solutions end-to-end.
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data
• design data models that can support ever-growing volumes
• contribute to all stages of the software development lifecycle
• provide technical expertise, recommendations, and innovative solutions
• work collaboratively with the product owner and other technologists
• share expertise and best practices with colleagues and contribute to engineering culture

Skills

SQL

Python

Data pipelines

Batch/stream processing

AI in SDLC

Big Data

Data Warehouse

Data Lake

Unix/Linux

Shell scripting

Spark

Delta Lake

DLT

GitLab

Azure

CI/CD

Testing

Education

Bachelor's degree in Computer Science or equivalent in IT

Tools

Databricks

Job description

Luxoft is seeking a senior data engineering professional to design and maintain data-driven applications in Poland. You will build scalable data pipelines for high-volume batch and streaming data, with end-to-end ownership and collaboration across product and engineering teams.

The role requires extensive experience with SQL, Python, Databricks, Spark, Delta Lake, and cloud technologies, ensuring high throughput and low latency analytics.