Senior PySpark Developer — Global Regulatory Data Pipelines

Luxoft; Warszawa; On-site; PLN 220,000 - 300,000; Full time

Job summary

Luxoft in Warsaw is seeking a seasoned backend engineer to join a Regulatory Reporting Platform for a large US investment bank. You will design, develop, and maintain data pipelines and services in Python and Spark to produce high-quality regulatory outputs across jurisdictions.

You will collaborate with analysts and QA across Ukraine, Poland, and the US, translate complex regulatory requirements into scalable solutions, and help ensure data quality, performance, and reliability in a fast-paced

Qualifications

• 6+ years of commercial experience with Python.
• 2+ years of PySpark experience.
• Experience in designing and developing scalable, high-performance backend applications.
• Good knowledge of SQL and working with large datasets from multiple data sources.
• Strong problem-solving skills and ability to work effectively in a global distributed team.

Responsibilities

• Design, develop, and maintain solutions for a large-scale Regulatory Reporting Platform.
• Build and enhance data processing pipelines using Python and Apache Spark.
• Implement scalable logic for data ingestion, transformation, aggregation, and enrichment from multiple internal data sources.
• Develop and optimize batch processing jobs to support regulatory reports across multiple jurisdictions.
• Ensure high standards of data quality, validation, reconciliation, and consistency throughout the reporting lifecycle.
• Translate business and regulatory requirements into robust technical solutions.
• Collaborate with business analysts, QA engineers, and cross-functional teams to deliver reporting functionality.
• Investigate and resolve data and application issues in development, test, and production environments.
• Improve application performance, scalability, and reliability for high-volume data processing workloads.
• Contribute to the design and implementation of reusable components and engineering best practices.
• Participate in code reviews, testing, and release activities to ensure high-quality deliverables.
• Work closely with distributed teams across Ukraine, Poland, and the US in an agile delivery model.
• Support continuous improvement of the platform, including monitoring, troubleshooting, and operational stability.

Skills

Python

PySpark

Backend development

SQL

Distributed teamwork

Job description

Luxoft in Warsaw is seeking a seasoned backend engineer to join a Regulatory Reporting Platform for a large US investment bank. You will design, develop, and maintain data pipelines and services in Python and Spark to produce high-quality regulatory outputs across jurisdictions.

You will collaborate with analysts and QA across Ukraine, Poland, and the US, translate complex regulatory requirements into scalable solutions, and help ensure data quality, performance, and reliability in a fast-paced