Data Engineer: Real-Time Pipelines & Scalable Analytics

Luxoft Poland; Wrocław; On-site; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Equipment, laptop and monitor

Job summary

Luxoft Poland is seeking a senior data/Regulatory Reporting engineer to design and maintain data-driven applications and scalable pipelines. You will build end-to-end solutions, optimize data flows, and implement robust analytics with modern tech.

The role requires 10+ years in IT, strong SQL, Python, Databricks, Spark, Delta Lake, and CI/CD experience, with a focus on high-throughput data processing and near real-time analytics.

Qualifications

• Bachelor's degree in Computer Science or IT with 10+ years of experience.
• Hands-on experience with SQL, Databricks, Python (advanced).
• Experience building scalable data pipelines for batch and streaming analytics.
• Experience with AI in engineering SDLC.
• Big Data, Data Warehouse, and Data Lake familiarity.
• Cloud technologies (Azure), Unix/Linux, and shell scripting.
• Spark, Delta Lake, DLT, GitLab experience.
• Designing high throughput, low latency data processing applications.
• Automated testing and CI/CD pipelines knowledge.

Responsibilities

• Design, implement, and maintain data-driven applications.
• Develop end-to-end data solutions and prototypes.
• Engineer reliable data pipelines for sourcing, processing, storing data.
• Design data models supporting growing data volumes.
• Contribute to all stages of the software development lifecycle.
• Provide technical expertise and innovative solutions.
• Collaborate with product owner and other engineers.

Skills

SQL

Python

Data pipelines

Batch & streaming

AI in SDLC

Data warehousing

Unix/Linux

Cloud Azure

Education

Bachelor's degree in Computer Science or IT

Tools

Databricks

Spark

Delta Lake

DLT

GitLab

Job description

Luxoft Poland is seeking a senior data/Regulatory Reporting engineer to design and maintain data-driven applications and scalable pipelines. You will build end-to-end solutions, optimize data flows, and implement robust analytics with modern tech.

The role requires 10+ years in IT, strong SQL, Python, Databricks, Spark, Delta Lake, and CI/CD experience, with a focus on high-throughput data processing and near real-time analytics.