Senior PySpark Data Engineer - Regulatory Reporting

Luxoft Poland; Warszawa; On-site; PLN 180,000 - 260,000; Full time

Job summary

Luxoft Poland is seeking a senior backend engineer to join a Regulatory Reporting Platform. You will design, develop, and maintain data pipelines, focusing on Python and PySpark, to support regulatory reporting across multiple jurisdictions.

You will collaborate with analysts, QA, and cross-functional teams in a distributed setup across Ukraine, Poland, and the US, ensuring scalable, high-quality delivery in a fast-paced environment.

Qualifications

• 6+ years of commercial Python experience.
• 2+ years of PySpark experience.
• Experience designing scalable backend applications.
• Strong SQL skills with large datasets.
• Ability to work effectively in a global distributed team.

Responsibilities

• Design, develop, and maintain solutions for a large-scale Regulatory Reporting Platform.
• Build and enhance data processing pipelines using Java and Apache Spark.
• Implement scalable data ingestion, transformation, and enrichment from multiple sources.
• Develop and optimize batch processing jobs for regulatory reporting across jurisdictions.
• Ensure data quality, validation, reconciliation, and consistency throughout reporting.

Skills

Python

PySpark

Backend development

SQL

Data processing

Job description

Luxoft Poland is seeking a senior backend engineer to join a Regulatory Reporting Platform. You will design, develop, and maintain data pipelines, focusing on Python and PySpark, to support regulatory reporting across multiple jurisdictions.

You will collaborate with analysts, QA, and cross-functional teams in a distributed setup across Ukraine, Poland, and the US, ensuring scalable, high-quality delivery in a fast-paced environment.