Senior Data Engineer — Databricks, PySpark & Lakehouse

Luxoft Poland; Polska; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Private Medical & Dental care & Life保险

MyBenefit program

Internal Mobility program

Job summary

Luxoft Poland is seeking an experienced Data Engineer to design, build, and operate data pipelines and models powering analytics across investment teams and the middle/back office. You will own data end-to-end, from ingestion to lakehouse modeling, ensuring data is discoverable, reliable, and cost-efficient.

You will partner with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures balancing speed, governance, and scalability.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems or related field.
• 5+ years in data engineering roles.
• Strong hands-on Databricks in production environments.
• Strong PySpark and SQL, declarative pipelines on Databricks.
• Understanding of data ingestion, transformation, and testing.
• Experience with lakehouse concepts and data governance practices.
• Familiarity with vendor market data feeds and CI/CD pipelines.

Responsibilities

• Participate in requirements clarification and sprint planning.
• Design and implement ETL pipelines with PySpark for robust data movement.
• Optimize ETL processes for performance and reliability.
• Write unit and integration tests; support QA in acceptance.
• Resolve PROD incidents as a 3rd line engineer.

Skills

PySpark

SQL

Databricks

Data pipelines

CI/CD

Education

Bachelor's degree

Tools

CI/CD pipelines

Delta Lake

Job description

Luxoft Poland is seeking an experienced Data Engineer to design, build, and operate data pipelines and models powering analytics across investment teams and the middle/back office. You will own data end-to-end, from ingestion to lakehouse modeling, ensuring data is discoverable, reliable, and cost-efficient.

You will partner with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures balancing speed, governance, and scalability.