Senior PySpark Developer - Global Regulatory Data Platform

Luxoft; Wrocław; On-site; PLN 180,000 - 260,000; Full time

Job summary

Luxoft is seeking a senior backend developer to join a Regulatory Reporting Platform for a large US investment bank. The role focuses on building scalable data pipelines using Python and PySpark, validating data quality, and delivering compliant regulatory outputs across many jurisdictions.

You will work with teams across Ukraine, Poland, and the US in an Agile setup, improving performance and reliability of high-volume data processing and contributing to reusable engineering components.

Qualifications

• 6+ years of commercial experience with Python.
• 2+ years of PySpark experience.
• Experience in designing and developing scalable, high-performance backend applications.
• Good knowledge of SQL and working with large datasets from multiple data sources.
• Strong problem-solving skills and ability to work effectively in a global distributed team.

Responsibilities

• Design, develop, and maintain solutions for a large-scale Regulatory Reporting Platform.
• Build and optimize data processing pipelines using Java and Apache Spark.
• Implement scalable data ingestion, transformation, and enrichment from multiple internal sources.
• Develop and optimize batch processing jobs for regulatory reports across jurisdictions.
• Ensure data quality, validation, reconciliation, and consistency throughout the reporting lifecycle.
• Collaborate with analysts, QA, and cross-functional teams to deliver reporting functionality.
• Troubleshoot issues in development, test, and production environments.
• Improve performance, scalability, and reliability for high-volume data processing.
• Contribute to reusable components and engineering best practices.
• Participate in code reviews, testing, and release activities.
• Work with distributed teams in Ukraine, Poland, and the US in an Agile setup.

Skills

Python

PySpark

Backend development

SQL

Distributed team collaboration

Tools

Spark

Job description

Luxoft is seeking a senior backend developer to join a Regulatory Reporting Platform for a large US investment bank. The role focuses on building scalable data pipelines using Python and PySpark, validating data quality, and delivering compliant regulatory outputs across many jurisdictions.

You will work with teams across Ukraine, Poland, and the US in an Agile setup, improving performance and reliability of high-volume data processing and contributing to reusable engineering components.