Senior Data Engineer: End-to-End Pipelines & Lakehouse (Finance)

Luxoft Poland; Polska; On-site; PLN 180,000 - 250,000; Full time

Benefits offered by this job

LuxMed

Life and travel insurance

MyBenefit program

Employee Assistance Program

Car rental options

Job summary

Luxoft Poland is seeking an experienced Data Engineer to design, build, and operate data pipelines and models powering analytics across investment teams and middle/back offices. You will own data end-to-end—from ingestion to lakehouse modeling—making data discoverable, reliable, and cost-efficient.

You will collaborate with BAs/PMs and quants, participate in sprint planning, and implement PySpark ETL pipelines on Databricks with strong SQL and data governance.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or related discipline.
• 5+ years experience in data engineering roles.
• Strong hands-on Databricks experience in production environments.
• Strong PySpark and SQL experience.
• Experience with Declarative Pipelines / pipeline orchestration on Databricks.
• Understanding of ingestion, transformation, incremental processing, testing, and performance tuning.
• Experience delivering production-ready datasets with monitoring and reliability patterns.
• Knowledge of lakehouse concepts (Delta tables) and data governance practices.
• Familiarity with CI/CD pipelines in enterprise environments and vendor market data feeds.

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement ETL Pipelines – Build robust data pipelines in PySpark to extract, transform, using PySpark
• Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.
• Resolving PROD incidents as a 3rd line engineer.

Skills

Databricks

PySpark

SQL

Data Pipelines

CI/CD

Data Governance

Market Data Feeds

Education

Bachelor’s degree

Tools

Databricks

Delta Lake

Palantir Foundry

Job description

Luxoft Poland is seeking an experienced Data Engineer to design, build, and operate data pipelines and models powering analytics across investment teams and middle/back offices. You will own data end-to-end—from ingestion to lakehouse modeling—making data discoverable, reliable, and cost-efficient.

You will collaborate with BAs/PMs and quants, participate in sprint planning, and implement PySpark ETL pipelines on Databricks with strong SQL and data governance.