Senior Data Engineer

Luxoft Poland; Polska; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Private Medical & Dental care & Life保险

MyBenefit program

Internal Mobility program

Job summary

Luxoft Poland is seeking an experienced Data Engineer to design, build, and operate data pipelines and models powering analytics across investment teams and the middle/back office. You will own data end-to-end, from ingestion to lakehouse modeling, ensuring data is discoverable, reliable, and cost-efficient.

You will partner with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures balancing speed, governance, and scalability.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems or related field.
• 5+ years in data engineering roles.
• Strong hands-on Databricks in production environments.
• Strong PySpark and SQL, declarative pipelines on Databricks.
• Understanding of data ingestion, transformation, and testing.
• Experience with lakehouse concepts and data governance practices.
• Familiarity with vendor market data feeds and CI/CD pipelines.

Responsibilities

• Participate in requirements clarification and sprint planning.
• Design and implement ETL pipelines with PySpark for robust data movement.
• Optimize ETL processes for performance and reliability.
• Write unit and integration tests; support QA in acceptance.
• Resolve PROD incidents as a 3rd line engineer.

Skills

PySpark

SQL

Databricks

Data pipelines

CI/CD

Education

Bachelor's degree

Tools

CI/CD pipelines

Delta Lake

Job description

We're looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments - proactively shaping solutions, not waiting for tickets. You'll own data end-to-end: from ingesting vendor and internal sources, to modeling in our lakehouse, to making data discoverable, reliable, and cost-efficient. You'll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities:

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement them, inc ETL Pipelines – Build robust data pipelines in PySpark to extract, transform, using PySpark
• Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.
• Resolving PROD incidents as a 3rd line engineer.

Mandatory Skills Description:

• Bachelor's degree (Computer Science, Engineering, Information Systems, or related discipline).
• 5+ years experience in data engineering roles (flexible based on depth of capability).
• Strong hands-on experience with Databricks in production environments (prerequisite).
• Strong programming experience with PySpark (must) and strong SQL (must).
• Proven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).
• Strong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.
• Experience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).
• Experience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).
• Exposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.
• Experience working in enterprise environments with CI/CD pipelines and structured release processes.
• Familiarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.

Opportunity for Poland-based candidates

Benefits

• Tax-deductible costs on a contract of employment for all development roles
• Stable employment based on an employment contract
• Private Medical & Dental care & Life Insurance
• MyBenefit program (sports card, well-being program etc.)
• Internal Mobility program - possibility of rotation between projects, locations, accounts